User interface for browsing content from multiple content applications on electronic device

By presenting and classifying content from different media applications in a unified media browsing application, the problems of complex and inefficient user interaction in the prior art are solved, and a simplified browsing and playback experience is achieved.

CN119807449APending Publication Date: 2025-04-11APPLE INC
View PDF 18 Cites 0 Cited by

Patent Information

Application Number
CN202411935695.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2017-09-28
Filing Date
2017-10-24
Publication Date
2025-04-11

AI Technical Summary

Technical Problem

The prior art is difficult to uniformly browse and play content from multiple content applications on electronic devices, resulting in complex and inefficient user interactions.

Method used

By presenting media items from different media applications in the unified media browsing application and promoting browsing based on media categories, the settings and operations of the unified media browsing user interface are realized.

Benefits of technology

Simplifies user interaction with electronic devices, improves the efficiency of browsing and playing content, and reduces user interaction time, especially when the device is powered by a battery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119807449A_ABST
    Figure CN119807449A_ABST
Patent Text Reader

Abstract

The invention relates to a user interface for browsing content from multiple content applications on an electronic device. In some implementations, an electronic device presents media items from different media applications in a unified media browsing application. In some embodiments, an electronic device facilitates browsing media from different media applications based on media categories (e.g., movies, television programs, etc. In some embodiments, an electronic device facilitates setting a unified media browsing application that presents media items from different media applications in a unified media browsing user interface. In some embodiments, an electronic device displays a plurality of episodes in a collection of episode content (e.g., a television series) in a user interface for the collection of episode content. In some embodiments, an electronic device displays a representation of a live event media item accessible on the electronic device and provides access to the live event media item.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application with international application number PCT / 2017 / 058132, international application date October 24, 2017, application number 201780066823.6, and invention name: "User interface for browsing content from multiple content applications on an electronic device", which entered the Chinese national phase on April 26, 2019.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application claims priority to U.S. Provisional Application Serial No. 62 / 413,333, filed on October 26, 2016, U.S. Provisional Application Serial No. 62 / 423,150, filed on November 16, 2016, U.S. Provisional Application Serial No. 62 / 556,912, filed on September 11, 2017, and U.S. Patent Application Serial No. 15 / 719,404, filed on September 28, 2017; all of which are hereby incorporated by reference in their entirety. Technical Field

[0004] The present invention generally relates to electronic devices that allow browsing and playing of content, and user interaction with such devices. Background Art

[0005] In recent years, users' interactions with electronic devices have increased significantly. These devices can be devices such as computers, tablets, televisions, multimedia devices, mobile devices, etc.

[0006] In some cases, such devices can access content or media (e.g., music, movies, television programs, etc.) through content applications installed on the device and associated with the content provider, and user interaction with such devices requires using the content application to browse and play the content. Enhancing these interactions can improve the user's experience with the device and reduce user interaction time, which is particularly important when the input device is battery-powered. Summary of the Invention

[0007] Some embodiments described in the present disclosure relate to one or more electronic devices that present media items from different media applications in a unified media browsing application, and one or more operations related to the above that these electronic devices optionally perform. Some embodiments described in the present disclosure relate to one or more electronic devices that facilitate browsing of media from different media applications based on media categories (e.g., movies, TV shows, etc.), and one or more operations related to the above that these electronic devices optionally perform. Some embodiments described in the present disclosure relate to one or more electronic devices that facilitate the setting of a unified media browsing application that presents media items from different media applications in a unified media browsing user interface, and one or more operations related to the above that these electronic devices optionally perform. Some embodiments described in the present disclosure relate to one or more electronic devices that display multiple episodes of each content collection (e.g., a TV series) in a user interface for each episode of a content collection, and one or more operations related to the above that these electronic devices optionally perform. Some embodiments described in the present disclosure relate to one or more electronic devices that display representations of live event media items accessible on one or more electronic devices and provide access to these live event media items, and one or more operations related to the above that these electronic devices optionally perform. While the drawings and detailed description provide a comprehensive description of the embodiments, it should be understood that the summary provided above does not limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, in which like reference numerals designate corresponding parts throughout the several views.

[0009] Figure 1A is a block diagram illustrating a multifunction device with a touch-sensitive display according to some embodiments of the present disclosure.

[0010] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments of the present disclosure.

[0011] Figure 2 A multifunction device with a touch screen according to some embodiments of the present disclosure is shown.

[0012] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments of the present disclosure.

[0013] Figure 4 An exemplary user interface for a multifunction device having a touch-sensitive surface that is separate from the display is shown in accordance with some embodiments of the present disclosure.

[0014] Figures 5A to 5B A block diagram illustrating an exemplary architecture for a device according to some embodiments of the present disclosure is shown.

[0015] Figures 6A to 6LL An exemplary manner in which an electronic device according to some embodiments of the present disclosure presents suggested media items (e.g., movies, television programs, etc.) to a user in a unified media browsing application is shown.

[0016] Figures 7A to 7L is a flow diagram illustrating a method of presenting suggested media items (eg, movies, television shows, etc.) to a user in a unified media browsing application according to some embodiments of the present disclosure.

[0017] Figures 8A to 8GG An exemplary manner in which an electronic device facilitates browsing of media items by category according to some embodiments of the present disclosure is shown.

[0018] 9A to 9I is a flow chart illustrating a method of facilitating browsing of media items by category, according to some embodiments of the present disclosure.

[0019] Figures 10A to 10Z An exemplary manner in which an electronic device facilitates the setup of a unified media browsing application according to some embodiments of the present disclosure is shown.

[0020] Figures 11A to 11F is a flow chart illustrating a method of facilitating setup of a unified media browsing application according to some embodiments of the present disclosure.

[0021] Figures 12A to 12V An exemplary manner in which an electronic device displays representations of episodes in each content collection according to some embodiments of the present disclosure is shown.

[0022] 13A to 13E is a flow chart illustrating a method of displaying representations of episodes in each content collection according to some embodiments of the present disclosure.

[0023] Figures 14 to 17 is a functional block diagram of an electronic device according to some embodiments of the present disclosure.

[0024] Figures 18A to 18J Exemplary methods are shown for an electronic device to display representations of and provide access to live event media items accessible on the electronic device according to some embodiments of the present disclosure.

[0025] Figures 19A to 19K is a flow chart illustrating a method of displaying representations of and providing access to live event media items accessible on an electronic device, according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0026] In the following description of the embodiments, reference will be made to the accompanying drawings, which form a part of the following description and show, by way of example, specific embodiments that may be implemented. It should be understood that other embodiments may be optionally used and structural changes may be optionally made without departing from the scope of the disclosed embodiments. In addition, although the following description uses the terms "first," "second," etc. to describe various elements, these elements should not be limited by the terms. These terms are merely used to distinguish one element from another. For example, a first touch may be named a second touch and similarly, a second touch may be named a first touch without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0027] The terms used in the description of the various described embodiments herein are only for the purpose of describing specific embodiments and are not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms "a", "an" and "the" are intended to also include plural forms unless the context clearly indicates otherwise. It will also be understood that the terms "and / or" used herein refer to and encompass any and all possible combinations of one or more items in the items listed in association. It will also be understood that the terms "comprises" and / or "comprising" when used in this manual specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their groupings.

[0028] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that," or "if [stated condition or event] is detected" are optionally interpreted to mean "upon determining," or "in response to determining," or "upon detecting [stated condition or event]," or "in response to detecting [stated condition or event]," depending on the context.

[0029] Exemplary devices

[0030] Embodiments of electronic devices, user interfaces for such devices, and processes associated with using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). Devices, iPod equipment, and Device. Other portable electronic devices are optionally used, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer or television with a touch-sensitive surface (e.g., touch screen displays and / or touchpads). In some embodiments, the device does not have a touch screen display and / or touchpad, but is capable of outputting display information (such as a user interface of the present disclosure) for display on an independent display device, and is capable of receiving input information from an independent input device with one or more input mechanisms (such as one or more buttons, touch screen displays and / or touchpads). In some embodiments, the device has a display, but is capable of receiving input information from an independent input device with one or more input mechanisms (such as one or more buttons, touch screen displays and / or touchpads).

[0031] In the following discussion, an electronic device is described that includes a display and a touch-sensitive surface. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick. In addition, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Therefore, as used in this disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device for display on an independent display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of an electronic device) is optionally used to describe input received on an independent input device, and the electronic device receives input information from the independent input device.

[0032] The device typically supports a variety of applications, such as one or more of the following applications: a drawing application, a rendering application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0033] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports the various applications with a user interface that is intuitive and clear to the user.

[0034] Attention is now directed to embodiments of a portable or non-portable device having a touch-sensitive display, although the device need not include a touch-sensitive display or a general display, as described above. Figure 1A 1 is a block diagram illustrating a portable or non-portable multifunction device 100 with a touch-sensitive display 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a touch-sensitive display system. The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contacts on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0035] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, the force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in pressure units). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that would not otherwise be accessible to the user on a smaller device with limited real estate, which is used to display an enable indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0036] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device that will be detected by a user using the user's sense of touch. For example, when a device or a component of the device is in contact with a surface that is touch-sensitive to a user (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation that corresponds to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" on a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click," even when the physical actuation button associated with the touch-sensitive surface that was physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "up click," "down click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate the described sensory perception for a typical (or average) user.

[0037] It should be understood that device 100 is only one example of a portable or non-portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown in the figure are implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits. Figure 1A The various components shown in are, optionally, implemented on two or more devices; for example, a display and audio circuitry on a display device, a touch-sensitive surface on an input device, and the remaining components on device 100. In such embodiments, device 100 optionally communicates with the display device and / or input device to facilitate operation of the system as described in this disclosure, and the various display and / or input-related components described herein remain in device 100 or are optionally included in the display and / or input device as appropriate.

[0038] Memory 102 optionally includes high-speed random access memory and optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0039] Peripherals interface 118 may be used to couple the device's input and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data.

[0040] In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0041] RF (radio frequency) circuitry 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals into / from electromagnetic signals and communicates with a communication network and other communication devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuitry 108 optionally communicates with a network and other devices via wireless communications, such as the Internet (also known as the World Wide Web (WWW)), an intranet, and / or a wireless network (such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN)). RF circuitry 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as by a short-range communication radio component. The wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g), IEEE 802.11f, IEEE 802.11g ... 11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

[0042] The audio circuit 110, the speaker 111, and the microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0043] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input or control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the one or more input controllers 160 are optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an up / down button for volume control of the speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206 in the ).

[0044] A quick press of the push button optionally unlocks the touch screen 112 or optionally begins the process of unlocking the device using gestures on the touch screen, as described in U.S. patent application Ser. No. 11 / 322,549, filed Dec. 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," (U.S. Pat. No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0045] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. As described above, the touch-sensitive operation and display operation of the touch-sensitive display 112 are optionally separated from each other, so that the display device is used for display purposes, and the touch-sensitive surface (whether it is a display or not) is used for input detection purposes, and the components and functions described are modified accordingly. However, for the sake of brevity, the following description is provided with reference to the touch-sensitive display. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual outputs or all of the visual outputs correspond to user interface objects.

[0046] The touch screen 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from the user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact on the touch screen 112 (and any movement or interruption of that contact) and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0047] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In one exemplary embodiment, projected mutual capacitance sensing technology is used, such as the ATmega 200 from Apple Inc. (Cupertino, California). iPod and Discovery technology.

[0048] The touch-sensitive display in some embodiments of the touch screen 112 is optionally similar to the multi-touch-sensitive trackpads described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, whereas a touch-sensitive touchpad does not provide visual output.

[0049] In some embodiments, the touch-sensitive display of the touch screen 112 is as described in the following patent applications: (1) U.S. patent application 11 / 381,313, filed on May 2, 2006, entitled "Multipoint Touch Surface Controller"; (2) U.S. patent application 10 / 840,862, filed on May 6, 2004, entitled "Multipoint Touchscreen"; (3) U.S. patent application 10 / 903,964, filed on July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices"; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices"; (5) U.S. patent application No. 11 / 050,264, filed on January 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive and (9) U.S. patent application Ser. No. 11 / 367,749, filed March 3, 2006, entitled “Multi-Functional Hand-Held Device.” All of these applications are hereby incorporated by reference in their entirety.

[0050] The touch screen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or appendage, such as a stylus, a finger, or the like, to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positions or commands for performing the user's desired action.

[0051] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0052] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuitry, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable or non-portable device.

[0053] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor is shown coupled to the optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from the touch screen display 112 on the front of the device, enabling the touch screen display to be used as a viewfinder for still and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing the user to optionally capture an image of the user while viewing other video conference participants on the touch screen display for video conferencing. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing), allowing a single optical sensor 164 to be used with the touch screen display for both video conferencing and still and / or video image acquisition.

[0054] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to force sensor controller 159 in I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100 opposite touch screen display 112 located on the front of device 100.

[0055] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1AA proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent applications: 11 / 241,839, entitled “Proximity Detector In Handheld Device”; 11 / 240,788, entitled “Proximity Detector In Handheld Device”; 11 / 620,702, entitled “Using Ambient Light Sensor To Augment Proximity Sensor Output”; 11 / 586,862, entitled “Automated Response To And Sensing Of User Activity In Portable Devices”; and 11 / 638,251, entitled “Methods And Systems For Automatic Configuration Of Peripherals,” which are hereby incorporated by reference in their entireties. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.

[0056] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1A A tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting electrical signals into tactile outputs on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates tactile outputs on the device 100 that can be sensed by a user of the device 100. In some embodiments, at least one tactile output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile outputs by moving the touch-sensitive surface vertically (e.g., inward / outward toward the surface of the device 100) or laterally (e.g., back and forth in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0057] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripherals interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally implements as described in the following U.S. Patent Publication: U.S. Patent Publication 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from one or more accelerometers. Device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) in addition to one or more accelerometers 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of device 100.

[0058] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications, if any, are currently active; a display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; a sensor state, which includes information obtained from the device's various sensors and input control devices 116; and position information regarding the device's position and / or posture.

[0059] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitating communication between various hardware components and software components.

[0060] The communication module 128 facilitates communication with other devices through one or more external ports 124 and also includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are suitable for coupling directly to other devices or indirectly through a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used on iPod (trademark of Apple Inc.) devices.

[0061] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger down event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there has been movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger up event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a sequence of contact data. These operations are optionally applied to a single contact (e.g., a one-finger contact) or to multiple simultaneous contacts (e.g., "multi-touch" / multiple-finger contacts). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touchpad.

[0062] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen display can be set to any one of a large range of predefined thresholds. In addition, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0063] The contact / motion module 130 optionally detects gesture input from the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.

[0064] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, and the like.

[0065] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed from an application program or the like, along with coordinate data and other graphic attribute data, if necessary, and then generates screen image data for output to the display controller 156.

[0066] Haptic feedback module 133 includes various software components for generating instructions used by one or more tactile output generators 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0067] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0068] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services such as a weather widget, local pages widget, and map / navigation widget).

[0069] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof:

[0070] Contacts module 137 (sometimes called address book or contact list);

[0071] Telephone module 138;

[0072] Video conferencing module 139;

[0073] Email client module 140;

[0074] Instant messaging (IM) module 141;

[0075] Fitness support module 142;

[0076] A camera module 143 for still and / or video images;

[0077] Image management module 144;

[0078] Video player module;

[0079] Music player module;

[0080] Browser module 147;

[0081] Calendar module 148;

[0082] Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, and user-created widgets 149-6;

[0083] A widget creator module 150 for forming user-created widgets 149-6;

[0084] Search module 151;

[0085] Video and music player module 152, which combines the video player module and the music player module;

[0086] Notepad module 153;

[0087] Map module 154; and / or

[0088] Online video module 155.

[0089] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0090] In combination with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contacts module 137 is optionally used to manage an address book or contact list (e.g., stored in the application internal state 192 of the contacts module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating telephone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing telephone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.

[0091] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a character sequence corresponding to a phone number, access one or more phone numbers in contacts module 137, modify an entered phone number, dial the corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0092] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the touch / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, executing and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0093] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0094] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0095] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music player module, the fitness support module 142 includes executable instructions for creating a workout (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for a workout; and displaying, storing, and transmitting fitness data.

[0096] In combination with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.

[0097] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0098] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet (including searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages) in accordance with user instructions.

[0099] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing a calendar and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0100] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5) or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the Yahoo! desktop widget).

[0101] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the desktop widget creator module 150 is optionally used by a user to create a desktop widget (e.g., converting a user-specified portion of a web page into a desktop widget).

[0102] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0103] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0104] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0105] In combination with the RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0106] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for allowing a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a particular online video. Additional descriptions of online video applications can be found in U.S. provisional patent application 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. patent application 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.

[0107] Each of the above modules and applications corresponds to an executable instruction set for performing one or more of the above functions and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as separate software programs, processes, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0108] In some embodiments, device 100 is a device that performs operations on a predefined set of functions on it solely through a touch screen and / or a touch pad. By using the touch screen and / or the touch pad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.

[0109] A predefined set of functions that are exclusively performed through the touch screen and / or trackpad optionally includes navigation between user interfaces. In some embodiments, the trackpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, home menu, or root menu. In such embodiments, the trackpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.

[0110] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0111] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0112] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating information being displayed by the application or information ready for display by the application 136-1, a state queue for enabling the user to return to a previous state or view of the application 136-1, and a redo / undo queue of previous actions taken by the user.

[0113] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0114] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0115] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0116] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0117] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to programmatic levels within the application's programmatic or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined based at least in part on the hit view of the initial touch that started the touch-based gesture.

[0118] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy where the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0119] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, views higher in the hierarchy will still remain actively participating views.

[0120] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver 182.

[0121] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module stored in memory 102, such as contact / motion module 130.

[0122] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 is part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application's internal state 192. Alternatively, one or more of the application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0123] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event from the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0124] The event receiver 182 receives event information from the event classifier 170. The event information includes information about sub-events such as touches or touch movements. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0125] Event comparator 184 compares event information with predefined event or sub-event definitions and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, the sub-events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0126] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view (in which three user interface objects are displayed on touch display 112), when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler that is associated with the sub-event and the object that triggered the hit test.

[0127] In some embodiments, the definition of the corresponding event 187 also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0128] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definitions 186, the corresponding event recognizer 180 enters the event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0129] In some embodiments, the corresponding event recognizers 180 include metadata 183 having configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery for actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0130] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating an event handler 190 is different from sending (and deferred sending) sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 issues a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.

[0131] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with the actively participating view receives the event information and performs a predetermined process.

[0132] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.

[0133] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or are included in application view 191. In other embodiments, they are included in two or more software modules.

[0134] It should be understood that the above discussion of event handling for user touches on a touch-sensitive display also applies to other forms of user input utilizing input devices to operate the multifunction device 100, and not all user input is initiated on a touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a trackpad, such as taps, drags, scrolls, etc.; stylus input; movement of the device; spoken commands; detected eye movement; biometric input; and / or any combination thereof, are optionally used as input corresponding to sub-events defining the event to be recognized.

[0135] Figure 2 A portable or non-portable multifunction device 100 with a touch screen 112 according to some embodiments is shown. As described above, the multifunction device 100 is described as having various illustrated structures (such as the touch screen 112, the speaker 111, the accelerometer 168, the microphone 113, etc.); however, it should be understood that these structures may optionally reside on separate devices. For example, display-related structures (e.g., a display, a speaker, etc.) and / or functionality may optionally reside on a separate display device, input-related structures (e.g., a touch-sensitive surface, a microphone, an accelerometer, etc.) and / or functionality may optionally reside on a separate input device, and the remaining structures and / or functionality may optionally reside on the multifunction device 100.

[0136] The touch screen 112 optionally displays one or more graphics within the user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of the graphics by, for example, making a gesture on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user interrupts contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or rolling of a finger that has made contact with the device 100 (from right to left, from left to right, up and / or down). In some embodiments or in some cases, accidentally making contact with a graphic does not select the graphic. For example, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0137] The device 100 optionally also includes one or more physical buttons, such as a "home" button, or a menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0138] In one embodiment, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on and off and locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on and off by pressing and holding the button for a predefined time interval; to lock the device by pressing and releasing the button before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions via the microphone 113. The device 100 also optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.

[0139] Figure 33 is a block diagram of an exemplary multi-function device with a display and a touch-sensitive surface according to some embodiments. As described above, the device 300 does not have to include a display and a touch-sensitive surface. Instead, in some embodiments, it optionally communicates with displays and touch-sensitive surfaces on other devices. In addition, the device 300 does not have to be portable. In some embodiments, the device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device (such as a television or set-top box), a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home or industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as chipsets) that interconnect system components and control communication between system components. The device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and touchpad 355, a tactile output generator 357 for generating tactile output on device 300 (e.g., similar to the above referenced embodiments). Figure 1A The one or more tactile output generators 167 described above), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch sensors, and / or contact intensity sensors (similar to the above referenced Figure 1A The one or more contact force sensors 165 described herein)). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores programs, modules, and data structures, or a subset thereof, similar to those of portable or non-portable multifunction device 100 ( Figure 1A ) stored in the memory 102 of the portable or non-portable multifunction device 100. In addition, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable or non-portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable or non-portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0140] Figure 3 Each of the above-mentioned identified elements is optionally stored in one or more of the previously mentioned memory devices. Each module in the above-mentioned identified module corresponds to a group of instructions for performing the functions described above. The above-mentioned identified module or program (that is, instruction set) need not be implemented as an independent software program, process or module, so the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subgroup of above-mentioned modules and data structure. In addition, memory 370 optionally stores other modules and data structure not described above.

[0141] Figure 4 B shows a display having a touch-sensitive surface 451 (eg, touch screen display 112) that is separate from a display 450 (eg, touch screen display 112). Figure 3 tablet or touchpad 355) of the device (e.g., Figure 3 Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 357) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 359 for generating tactile output for a user of device 300.

[0142] Although some of the examples below will be given with reference to input on a touch screen display 112 (where the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4 In some embodiments, the touch-sensitive surface (e.g., Figure 4 451) with a principal axis (e.g., Figure 4 452 in ), which corresponds to the main axis on the display (e.g., 450) (e.g., Figure 4 According to these embodiments, the device detects contact with the touch-sensitive surface 451 (e.g., Figure 4 460 and 462 in FIG), the location of the contact corresponds to a corresponding location on the display (e.g., Figure 4 , 460 corresponds to 468, and 462 corresponds to 470). Thus, when a touch-sensitive surface (e.g., Figure 4 451) and the display of the multi-function device ( Figure 4 When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0143] In addition, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). For another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting the contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or that a mouse and finger contact are optionally used simultaneously.

[0144] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor rests over a particular user interface element (e.g., a button, window, slider, or other user interface element), a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4 In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, a particular user interface element is adjusted according to the detected input. In the case that the touch-sensitive surface 451 in the display includes a touch-screen display (e.g., a touch-sensitive surface 451 in the display), a specific user interface element is adjusted according to the detected input. Figure 1AIn some implementations of a touch-sensitive display system 112 in a touch-sensitive display, a contact detected on the touch screen acts as a "focus selector" such that when input (e.g., a press input by a contact) is detected on the touch screen display at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move focus from one button to another); in these implementations, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or contact on the touch screen display) that is controlled by the user to convey the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0145] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact begins to move, before contact ends, before or after contact is detected to increase in intensity, and / or before or after contact is detected to decrease in intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.

[0146] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting an increase in the intensity of the contact (or multiple contacts) to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting an increase in the intensity of the corresponding contact to above the press input intensity threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below the press input intensity threshold, and the corresponding operation is performed in response to detecting a subsequent decrease in the intensity of the corresponding contact to below the press input threshold (e.g., an "up stroke" of the corresponding press input).

[0147] In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs, sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "upstroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and, optionally, that the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the circumstances).

[0148] For ease of explanation, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is optionally triggered in response to detecting any of the following: contact intensity increasing above the press input intensity threshold, contact intensity increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, contact intensity decreasing below the press input intensity threshold, and / or contact intensity decreasing below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.

[0149] Figure 5A A block diagram illustrating an exemplary architecture for a device 500 according to some embodiments of the present disclosure is shown. Figure 5A In an embodiment, media content or other content is optionally received by device 500 via network interface 502, which is optionally a wireless connection or a wired connection. One or more processors 504 optionally execute any number of programs stored in memory 506 or storage devices, the programs optionally including instructions for performing one or more of the methods and / or processes described herein (e.g., method 700).

[0150] In some embodiments, the display controller 508 causes the various user interfaces of the present disclosure to be displayed on the display 514. Additionally, input to the device 500 is optionally provided by a remote control 510 via a remote control interface 512, which is optionally a wireless or wired connection. In some embodiments, input to the device 500 is provided by a multifunction device 511 (e.g., a smartphone) on which a remote application is running that configures the multifunction device to simulate remote control functionality, as described in more detail below. In some embodiments, the multifunction device 511 corresponds to Figure 1A and Figure 2 Device 100 and Figure 3 One or more devices in the device 300. It should be understood that Figure 5A The embodiments are not meant to limit the features of the device of the present disclosure, and other components that facilitate other features described in the present disclosure are optionally included. Figure 5A In some embodiments, the device 500 optionally corresponds to Figure 1A and Figure 2 The multifunction device 100 and Figure 3 One or more devices in the device 300; the network interface 502 optionally corresponds to Figure 1A and Figure 2 RF circuit 108, external port 124 and peripheral device interface 118 in the Figure 3 One or more of the network communication interfaces 360 in; the processor 504 optionally corresponds to one or more of the following: Figure 1A One or more processors 120 and Figure 3 The one or more CPUs 310 in the display controller 508 optionally correspond to one or more of the following: Figure 1A The display controller 156 and Figure 3 The I / O interface 330 in the embodiment; the memory 506 optionally corresponds to one or more of the following: Figure 1A The memory 102 and Figure 3 The memory 370 in the remote control interface 512 optionally corresponds to one or more of the following: Figure 1A The peripheral device interface 118 and the I / O subsystem 106 (and / or its components) in Figure 3 The I / O interface 330 in the remote control 512 optionally corresponds to and / or includes one or more of the following: Figure 1Aspeaker 111, touch-sensitive display system 112, microphone 113, one or more optical sensors 164, one or more contact intensity sensors 165, one or more tactile output generators 167, other input control devices 116, one or more accelerometers 168, proximity sensor 166, and I / O subsystem 106, and Figure 3 keyboard / mouse 350, touchpad 355, one or more tactile output generators 357, and one or more contact intensity sensors 359, and Figure 4 and display 514 optionally corresponds to one or more of: Figure 1A and 2 a touch-sensitive display system 112 in FIG. 1 , and Figure 3 Display 340 in.

[0151] Figure 5B 1 shows an exemplary structure of a remote control 510 according to some embodiments of the present disclosure. In some embodiments, the remote control 510 optionally corresponds to Figure 1A and Figure 2 The multifunction device 100 and Figure 3 The remote control 510 optionally includes a touch-sensitive surface 451. In some embodiments, the touch-sensitive surface 451 is edge-to-edge (e.g., it extends to the edge of the remote control 510 so that there is little or no surface of the remote control 510 between the touch-sensitive surface 451 and one or more edges of the remote control 510, such as Figure 5BAs previously described in this disclosure, touch-sensitive surface 451 is optionally capable of sensing contact and contact intensity (e.g., a click on touch-sensitive surface 451). In addition, touch-sensitive surface 451 optionally includes a mechanical actuator for providing physical button click functionality (e.g., touch-sensitive surface 451 is "clickable" to provide corresponding input to device 500). Remote control 510 also optionally includes buttons 516, 518, 520, 522, 524, and 526. Buttons 516, 518, 520, 522, 524, and 526 are optionally mechanical buttons or mechanical button alternatives that are capable of sensing contact or pressing with such buttons to initiate one or more corresponding actions, for example, on device 500. In some embodiments, user selection of the “Menu” button 516 navigates the device 500 backward in a currently executing application or currently displayed user interface (e.g., backward to a user interface displayed before the currently displayed user interface), or navigates the device 500 to a user interface one level higher than the currently displayed user interface. In some embodiments, user selection of the “Home” button 518 navigates the device 500 from any user interface displayed on the device 500 to the main, home, or root user interface (e.g., to the home screen of the device 500, which optionally includes one or more applications accessible on the device 500). In some embodiments, user selection of the “Play / Pause” button 520 switches back and forth between playing and pausing a currently playing content item on the device 500 (e.g., if a content item is playing on the device 500 when the “Play / Pause” button 520 is selected, the content item is optionally paused, and if a content item is paused on the device 500 when the “Play / Pause” button 520 is selected, the content item is optionally played). In some embodiments, user selection of the "+" 522 or "-" 524 buttons increases or decreases the volume of audio reproduced by the device 500 (e.g., the volume of a content item currently playing on the device 500), respectively. In some embodiments, user selection of the "audio input" button 526 allows the user to provide audio input (e.g., voice input) to the device 500, optionally to a voice assistant on the device. In some embodiments, the remote control 510 includes a microphone via which the user provides audio input to the device 500 when the "audio input" button 526 is selected. In some embodiments, the remote control 510 includes one or more accelerometers for detecting information about the motion of the remote control.

[0152] User interface and associated processes

[0153] Unified media browsing interface

[0154] Users interact with electronic devices in a variety of different ways, including interacting with media (e.g., music, movies, etc.) available (e.g., stored or otherwise accessible) on the electronic device (e.g., as referenced in Figures 6A to 6LL 、 Figures 8A to 8GG 、 Figures 10A to 10Z 、 Figures 12A to 12V and / or Figures 18A to 18J As described above). For example, a user can browse and play media accessible on an electronic device. In some cases, the media may be obtained through different media applications installed on the electronic device. For example, a first media application on an electronic device optionally provides access to media from a first media provider, and a second media application on the electronic device optionally provides access to media from a second media provider. However, in some cases, the user must browse the media from each media application (and therefore the media provider) separately; however, the user may wish to browse media from different media applications in a unified media browsing user interface. The following embodiments provide a way for an electronic device to present suggested media items (e.g., movies, TV shows, etc.) from different media applications to the user in a unified media browsing application, thereby enhancing the interaction between the user and the electronic device. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, this person is optionally referred to as a user of the device.

[0155] Figures 6A to 6LL The following figures illustrate exemplary ways in which an electronic device according to some embodiments of the present disclosure may present suggested media items (e.g., movies, television programs, etc.) to a user in a unified media browsing application. The embodiments in these figures are used to illustrate the processes described below, including reference to Figures 7A to 7L Describe the process.

[0156] Figure 6A An exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 6A In the example shown, the display 514 displays a message on the electronic device (e.g., Figure 5AThe unified media browsing application is optionally an application that acts as a centralized media navigation application that displays representations of media items available from the various media applications installed on the electronic device to facilitate easy browsing and viewing of those media items by a user of the electronic device.

[0157] exist Figure 6A , the unified media browsing application displays a unified media browsing user interface 602 that includes a top menu bar that includes a "next" element, a "library" element, a "store" element, and a "search" element. Selection of a different element in the top menu bar optionally causes the unified media browsing application to display a user interface corresponding to the selected menu element. Figure 6A , the "next" menu element is selected, as indicated by the dashed border. Thus, the unified media browsing application is displaying user interface 602, as described herein. In some embodiments, the electronic device hides the top menu bar after a menu item is selected (e.g., after a predetermined time). Figures 8A to 8GG Describes additional details about other menu elements in the top menu bar.

[0158] exist Figure 6A , the user interface includes representations 606-1 through 606-6 of media items available from different media providers (e.g., representation 606-1 of media item A available from media provider 3, representation 606-2 of media item B available from media provider 1, etc.). The representations 606 include information identifying the media items to which they correspond (e.g., "Item A") and the media providers that can provide them (e.g., "Provider 3"). Figure 6AThe media items displayed in are optionally media items that the electronic device has suggested for the user of the electronic device and are determined by the electronic device to be suggested media items for various reasons, such as previous user actions associated with the media items and / or the user's previous media viewing activity. For example, the user may have partially watched some media items for them to be included in the user interface 602, the user may have favorited some media items for them to be included in the user interface 602, the user may have watched previous episodes of a television series for this episode / next episode to be included in the user interface 602, etc. Representations 606-5 and 606-6 optionally correspond to media that a third party (e.g., a media provider) has recommended for the user of the electronic device. In Figure 6A , representations 606 - 5 and 606 - 6 are partially displayed in user interface 602 .

[0159] The representation 606 is overlaid on a background that includes representative content from the media item that corresponds to the representation 606 that currently has focus in the user interface 602. Figure 6A , representation 606-2 corresponding to media item B currently has focus in user interface 602 (indicated by the dashed box within representation 606-2). Thus, representation 606 is overlaid on a background that includes representative content from media item B (indicated by the dashed box within representation 606-2). Figure 6A The representative content is optionally a still image corresponding to media item B (e.g., a pre-selected cover art associated with media item B, a still image from the current playback position in media item B, etc.) and / or a video (e.g., a video preview of media item B, a video loop of the current playback position in media item B, etc.). Figure 6A The context in FIG6 also includes information 612 corresponding to media item B because representation 606-2 corresponding to media item B has the current focus. Information 612 includes an indication of the title of media item B, an indication of the media provider that provided the media item (media provider 1), an indication of why media item B was included as a suggested media item in user interface 602 (media item B was purchased by the user), and an indication of how much of media item B has been played by the electronic device (media provider 1). Figure 6A A progress bar in (e.g., how much of media item B the user has watched), if any. Figure 6A Because media item B has been partially viewed, representation 606-2 also includes an indication (e.g., a progress bar) of how much of media item B the electronic device has played. In some embodiments, the progress indication included in the representation is included in the representation only while the representation has current focus (e.g., if representation 606-2 loses current focus, the electronic device optionally stops displaying the progress indicator in representation 606-2).

[0160] As different representations 606 in the user interface 602 gain current focus, the background of the user interface 602 changes accordingly. Moving the current focus indicator within the user interface 602 (e.g., from one representation 606 to another) is accomplished by directional input detected on the remote control device, such as a swipe detected on the touch-sensitive surface of the remote control device. The touch-sensitive surface 604 optionally corresponds to such a remote control device (e.g., the touch-sensitive surface 604 optionally is included in a multifunction device that is configured to emulate dedicated remote control functions in controlling the electronic device 500, or the touch-sensitive surface 604 optionally is included in a dedicated remote control device that controls the electronic device 500). A device in which the touch-sensitive surface 604 is included optionally corresponds to Figure 1A Device 100, Figure 2 Device 100, Figure 3 Device 300 and Figure 5A One or more of devices 510 and 511 in.

[0161] exist Figures 6B to 6D In FIG, a swipe of contact 608 from left to right has been detected on touch-sensitive surface 604. In response, the electronic device moves the current focus from representation 606-2 to representation 606-3, which corresponds to media item C from media provider 2, as shown in FIG. Figure 6D As shown. As a result, the electronic device replaces the background of user interface 602 with representative content from media item C and updates information 612 to correspond to media item C (e.g., including the title of media item C, an indication of media provider 2, and an indication that media item C is a suggested media item because the user of the electronic device has favorited media item C). Information 612 does not include an indication of how much of media item C the user has viewed because the user has not yet begun viewing media item C (e.g., the electronic device has not yet begun playback of media item C).

[0162] exist Figures 6E to 6G , another swipe of contact 608 from left to right has been detected on touch-sensitive surface 604. In response, the electronic device similarly moves the current focus from representation 606-3 to representation 606-7, which corresponds to media item G from media provider 3, as shown in FIG. Figure 6G As shown. The electronic device thus replaces the background of user interface 602 with representative content from media item G and updates information 612 to correspond to media item G (e.g., including the title of media item G, an indication of media provider 3, an indication that media item G is a suggested media item because the user of the electronic device rented media item G, and an indication of when the user's access to media item G expires). Figures 6E to 6G, the swipe of contact 608 causes the electronic device to scroll past the last representation 606-4 displayed in user interface 602. Thus, the electronic device has scrolled into representation 606-7 of user interface 602 and has scrolled out of user interface representation 606-1. Figures 6E to 6G The horizontal scrolling nature of the row of representations 606 in the user interface 602 is shown.

[0163] exist Figure 6H , a top-to-bottom swipe of contact 608 has been detected on touch-sensitive surface 604, causing the current focus to be navigated past the bottom edge of user interface 602. In response, the electronic device scrolls through user interface 602 to fully reveal representations 606-5 and 606-6 of recommended media items in user interface 602 and partially reveal other representations of trending media items (e.g., top movies, Figure 6H as Figure 6H As a result of a top-to-bottom swipe of contact 608 on touch-sensitive surface 604 in FIG, the electronic device moves the current focus from representation 606-7 to representation 606-6, as shown in FIG. Figure 6H In addition, in response to a top-to-bottom swipe of contact 608, the background of user interface 602 corresponding to one of representations 606-2, 606-3, 606-4, and 606-7 scrolls user interface 602 upward and outward according to the amount of downward scrolling achieved by the swipe. As further top-to-bottom swipes cause further downward scrolling in user interface 602, the background of the user interface moves further upward and out of user interface 602. In some embodiments, as the background of user interface 602 moves further upward, it becomes increasingly blurred and / or transparent.

[0164] exist Figure 6I , another swipe from top to bottom of contact 608 has been detected on touch-sensitive surface 604, causing the current focus to again be navigated past the bottom edge of user interface 602. In response, the electronic device scrolls through user interface 602 to fully reveal representations 614-1 through 614-4 of trending media items in user interface 602 (e.g., Top Movies, Figure 6I as Figure 6I As a result of the top-to-bottom swipe of contact 608 on touch-sensitive surface 604, the electronic device moves the current focus from representation 606-6 to representation 614-3, which corresponds to media item K from content provider 3, as shown in FIG. Figure 6H, and further moves the background of the user interface 602 upward and off the display. Representation 614 includes an indication of the title of the trending media item (e.g., Item 1, Item J, etc.) and an indication of the media provider that provided the trending media item (e.g., Media Provider 1, Media Provider 2, etc.). The trending media item is optionally different from the one that was displayed before the touch input for scrolling past the edge of the user interface 602 was detected (e.g., as shown in FIG. 2 ). Figure 6A The suggested media items are not initially displayed in the user interface 602 because the trending media items are media items that were not selected for inclusion in the user interface 602 based on the viewing activity of the user of the electronic device. For example, the trending media items are media items that are liked by other viewers or are media items that are otherwise selected by a third party (e.g., selected by the media provider for inclusion in the user interface 602 to promote the media item).

[0165] exist Figures 6J to 6K , another top-to-bottom swipe of contact 608 is detected on touch-sensitive surface 604, causing the current focus to again navigate past the bottom edge of user interface 602, and the electronic device to further scroll through user interface 602 to reveal in user interface 602 other representations 614-5 through 614-8 of trending media items in user interface 602 (e.g., Figure 6K In addition, the electronic device moves the current focus from representation 614-3 to representation 614-7, which corresponds to media item 0 from media provider 2, as shown in FIG. Figure 6K As further input is detected on touch-sensitive surface 604 that scrolls past the bottom edge of user interface 602 , additional representations of trending media items are optionally revealed in user interface 602 .

[0166] As previously described, the electronic device may optionally present the media item as a suggested media item (e.g., as shown in FIG. 1 ) for various reasons (e.g., the user has rented the media item, the user has purchased the media item, the user has partially viewed the media item, etc.). Figure 6A In some embodiments, a media item is suggested by the electronic device because the media item is part of an episodic media collection (e.g., a television series, a mini-series, etc.) and the user of the electronic device has watched previous media items in the episodic media collection (e.g., previous episodes in the television series). Figure 6L In FIG, the electronic device includes a representation 606-9 of the suggested media item A-2 and a representation 606-10 of the suggested media item A-1 in the user interface 602. The media item A-1 is optionally the first episode in the episodic media item set A, and the media item A-2 is optionally the second episode in the episodic media item set A. The user has purchased and partially watched the media item A-1. Figure 6LBecause the user has purchased and / or (at least partially) watched the media item A-1, the electronic device recommends the media item A-2 to the user, as shown in the information 612 in FIG. Figure 6L Furthermore, the electronic device has done so even though the user is viewing media item A-1 through media provider 1, and media item A-2 is available through a different media provider 3 rather than media provider 1. Figures 6M to 6N , a right-to-left swipe of contact 608 is detected on touch-sensitive surface 604, which presents representation 606-9 corresponding to media item A-2 (ie, the current focus).

[0167] In some embodiments, the electronic device prioritizes the display of suggested media item representations 606 based on time-related characteristics of those suggested media items. Figure 6N In the example, media item A-2 is a new episode of episodic media set A, that is, a new episode just released today (for example, the user of the electronic device has the right to view media item A-2 today because media provider 3 provides media item A-2 today). Thus, the electronic device preferentially displays representation 606-9 in representation 606, which corresponds to media item A-2. Specifically, the electronic device has placed representation 606-9 at the beginning of the list of suggested media items, as shown in FIG. Figure 6N As time passes, the electronic device may optionally cancel the priority display of representation 606-9 in representation 606. For example, Figure 6O In the embodiment of the present invention, the first embodiment of the present invention is a media item that is played by the user of the electronic device and the media item A-2 is played by the user of the electronic device. ...

[0168] As another example of an electronic device prioritizing display of suggested media item representations 606 based on time-related characteristics of the suggested media items, in some embodiments, the electronic device prioritizes display of suggested media items based on the length of time that the user's access rights to the suggested media items will remain valid (e.g., because the user rented a media item with a rental expiration date, because the media provider of the media item will cease providing the media item, etc.). Figure 6P In FIG, the electronic device displays representation 606-2 corresponding to media item B in the second position in the list of suggested media items. In addition, the user's access to media item B expires in 25 days, as shown in information 612. Figure 6Q , time passes, and the user's access to media item B now expires in three days. Because the expiration time is shorter than the time threshold (e.g., five days), the electronic device prioritizes representation 606-2 in representation 606 and displays representation 606-2 at the front of the list of suggested media items. As an exemplary scenario, when a user first rents a movie, the movie has a high priority within the suggested media representations (e.g., placed at the beginning of a "next" queue), and over time, the movie is gradually deprioritized (e.g., moved away from the beginning of the "next" queue as other items are added to the "next" queue based on user activity relative to the other items), but as the rental period of the movie nears its end (e.g., the movie rental expires in three days), the movie's priority in the suggested media representations is increased (e.g., the movie is moved to the beginning of the "next" queue) to remind the user that the rental is about to expire (e.g., the movie is moved to the beginning of the "next" queue without any user activity regarding the movie). By prioritizing the display of representations of certain media items based on temporal considerations, the electronic device more effectively communicates the availability of media items to the user, thereby increasing the efficiency with which such information is communicated to the user.

[0169] In some embodiments, detecting a selection input while a representation of a suggested media item has focus (e.g., on touch-sensitive surface 604) causes the electronic device to play the suggested media item. Figure 6R , a click on the touch-sensitive surface 451 of the remote control 510 (corresponding to the touch-sensitive surface 604 in the remaining figures) is detected when the representation 606-2 corresponding to the media item B from the media provider 1 has the current focus. In response, the electronic device launches the media application corresponding to the media provider 1 and plays the media item B in the media application, as shown in FIG. Figure 6S In some embodiments, when the electronic device is Figure 6R The unified media browsing application in the switch to the corresponding Figure 6SWhen the media application of media provider 1 in the media browsing application is used, the navigation hierarchy of the media application (rather than the navigation hierarchy of the unified media browsing application) controls the response of the electronic device to the navigation hierarchy change input detected at the remote control 510. For example, in Figure 6T , a click on the "Menu" button 516 of the remote control 510 is detected, which corresponds to a backward navigation input within the currently active navigation hierarchy on the electronic device (e.g., as referenced Figure 5B In response to clicking the “Menu” button 516, the electronic device navigates backward within the media application corresponding to the media provider 1 (e.g., returns to the main menu of the media application), as shown in FIG. Figure 6U As shown, rather than navigating back to the unified media browsing application that launched the media application, the user can navigate back to the unified media browsing application that launched the media application. Therefore, launching the media application from the unified media browsing application in the described manner is optionally a "deep" link to the media application. In some embodiments, a request to navigate back from a media item currently playing in a media application generates different responses based on how the user started playing the media item (e.g., if the user starts playing the media item by selecting it within the application, the request to navigate back causes the device to return to the previous screen in the application, but if the user starts playing the media item from a content aggregation user interface, the request to navigate back causes the device to return to the content aggregation user interface).

[0170] The behavior of the electronic device is opposite to that when the suggested media representation 606 is selected, as shown in FIG. Figures 6R to 6S As described above, when a trending media item representation is similarly selected, the electronic device may not immediately start playing the corresponding trending media item. Figure 6V , representation 614-3 corresponding to trending media item K has current focus. Figure 6W , when representation 614-3 has current focus, a click on the touch-sensitive surface 604 is detected, and in response, the electronic device does not begin playing media item K, but instead displays a specification page corresponding to media item K, which includes, for example, information 618 about media item K (e.g., genre, director, actors, user ratings, content ratings, length, release year, description, etc.) and information identifying media provider 3 (which media provider provided media item K). The specification page corresponding to media item K also includes a button 616, selection of which will cause the electronic device to play media item K in a media application corresponding to media provider 3. The specification page also includes a button 617 for playing a trailer / preview of media item K, a button 619 for browsing and selecting other media providers that can provide media item K and for playing media item K, and a button 621 for adding media item K to favorites (e.g., thereby making the media item available to other media providers). Figure 6A). Additionally, the canonical page includes media items (e.g., items AA, BB, CC, DD) that are related to media item K (e.g., of the same type) and selectable representations of the media items that are selected to navigate to the canonical pages for those media items.

[0171] In some embodiments, the electronic device displays representations of suggested media items in the user interface 602 even if the media application that provides the suggested media items is not installed on the electronic device. Figure 6Y , the electronic device displays representation 606-6 corresponding to media item F as a suggested media item. Media item F can be obtained via media provider 3. However, the media application corresponding to media provider 3 is not installed on the electronic device. The electronic device displays representation 606-6 anyway because displaying the representation allows the user to discover the existence of media item F and provides the user with an opportunity to install the media application to view media item F. In some embodiments, representation 606-6 is included in representation 606 based on previous user actions that occurred on a second electronic device that is different from the electronic device (for example, the user partially viewed the corresponding suggested media items on the second electronic device but not on the electronic device). In some embodiments, user actions on media items on other devices cause those media items to be displayed in the suggested media items on the current electronic device because (for example) the suggested media items are associated with a user account of the user, and the user is logged into multiple electronic devices, including the current electronic device and the second electronic device.

[0172] exist Figure 6Z In FIG, when representation 606-6 has current focus, a click on touch-sensitive surface 604 is detected. In response, because the media application corresponding to media provider 3 is not installed on the electronic device, the electronic device displays prompt 620, such as Figure 6AA As shown, the prompt indicates that the media application corresponding to the media provider 3 is not installed on the electronic device, and provides a button 622 for installing the media application and a button 624 for abandoning the installation of the media application. Figure 6BB In , selection of button 622 is detected, which causes the media application corresponding to media provider 3 to be installed on the electronic device. Figure 6CC , after the media application corresponding to the media provider 3 has been installed on the electronic device, the electronic device displays a prompt 621 indicating that the media application has been installed and provides a button 626 for authorizing the media application to provide access to its corresponding media (e.g., by providing the media application with login credentials that authenticate the user to the media provider 3), and a button 628 for not authorizing the media application to provide access to its corresponding media. Figure 6DD, selection of button 626 is detected, which authorizes the media application corresponding to media provider 3 to provide access to media from media provider 3, and in response to the authorization, the electronic device begins playing media item F without further input from the user, as shown in FIG. Figure 6EE As shown. Therefore, after installation and login or registration through the media application, the electronic device immediately begins to play back the media item in the media application, rather than displaying the navigation or initial startup user interface of the media application, such as the home screen of the media application. This result simplifies the user's experience of viewing media items when the media application needs to be installed for the first time. In some embodiments, the user of the electronic device may have previously authorized the media provider 3 to share user-specific information with the unified media browsing application (for example, settings in the account of the user logged in via the electronic device). In such cases, in response to detecting Figure 6Z In response to the selection of representation 606-6, the electronic device optionally automatically installs and / or authorizes the media application corresponding to the media provider 3 without further user input and starts playing the media item F, as shown in FIG. Figure 6EE shown.

[0173] Re-reference Figure 6Y and 6Z , selection of one of the representations 606 optionally causes the electronic device to produce different responses, depending on whether the electronic device has information about the user's current play position in the media corresponding to the selected representation 606, and / or whether the user has access to the media corresponding to the selected representation 606. Specifically, in some embodiments, the representation 606 corresponds to an episodic media collection (e.g., a television series with multiple episodes and / or multiple seasons), rather than a specific episode in the episodic media collection. The user of the electronic device may have access to watch zero, some, or all episodes in such a collection, and the electronic device may or may not have information about which episodes in the collection the user has already watched (e.g., the user's "current play position" in the episodic media collection corresponds to the next episode in the episodic media collection that the user has not yet watched. For example, if the user has already watched episodes 1 and 2, then episode 3 is optionally the episode at the user's current play position in the episodic media collection.) The following table summarizes the different responses of the electronic device in response to selection of such a representation 606.

[0174]

[0175]

[0176] In some embodiments, the electronic device has a private media browsing mode during which the user's media viewing activity is not tracked and / or media items suggested to the user based on the user's media viewing activity are not displayed by the unified media browsing application in the user interface 602. Figure 6FF In the case of electronic devices, the private media browsing mode of the electronic device is disabled (in Figure 6FF ) when displaying a representation 606 of the suggested media item. Figure 6GG , when the private media browsing mode of the electronic device is disabled, the electronic device begins playing a media item X from a media provider 3 on the electronic device (e.g., in response to an input sequence detected on the touch-sensitive surface 604, searching for the media item X on the electronic device and playing it). After playing the media item X, and when the private media browsing mode of the electronic device is disabled, the electronic device redisplays the user interface 602 with representations 606 of suggested media items before playback of the media item X has completed (e.g., in response to an input sequence detected on the touch-sensitive surface 604, opening a unified media browsing application on the electronic device). Figure 6HH As shown, since the user partially watched media item X, the electronic device includes representation 606-20 of media item X in representation 606 of recommended media items. In addition, because media item X is the latest media item added by the electronic device to representation 606, representation 606-20 corresponding to media item X is displayed at the front of the list of recommended media items.

[0177] exist Figure 6II The private media browsing mode of the electronic device is enabled (by Figure 6II In response, because the electronic device is now in private media browsing mode, the electronic device has stopped displaying representations 606 of suggested media items in user interface 602 and instead displays representations 614 of trending media items. When the electronic device is in private media browsing mode, if the user causes partial playback of a media item (e.g., media item W) on the electronic device, such as Figure 6JJ As shown, the user interface 602 is redisplayed, as shown in FIG. Figure 6L K, and private media browsing mode is disabled, as shown in Figure 6LL As shown, the electronic device will not include media item W as a suggested media item in representation 606 because media item W is played when the electronic device is in the private media browsing mode, and when the electronic device is in the private media browsing mode, the electronic device optionally does not track the user's media viewing activity.

[0178] Figures 7A to 7L7 is a flow chart illustrating a method 700 for presenting suggested media items (e.g., movies, television shows, etc.) to a user in a unified media browsing application according to some embodiments of the present disclosure. Method 700 is optionally performed on an electronic device (such as device 100, device 300, or device 500), as described above in conjunction with Figure 1A to Figure 1B 、 Figures 2 to 3 and Figures 5A to 5B Some operations in method 700 may be optionally combined, and / or the order of some operations may be optionally changed.

[0179] As described below, method 700 provides a way to present suggested media items to a user in a unified media browsing application. The method reduces the cognitive burden on the user when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.

[0180] In some embodiments, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) in communication with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510, or a smartphone, such as device 511) displays (702) in a user interface on the display (e.g., a media navigation user interface in which a user of the electronic device is able to browse media available on the electronic device) multiple representations of suggested media items on the electronic device that are available from different media sources, such as Figure 6A In some embodiments, the plurality of representations are displayed overlappingly on top of first representative content (e.g., a hero image or video clip), the first representative content corresponding to the representation of the first media item that currently has focus in the suggested media items, such as a first media item that is currently in focus in the suggested media items, and / or text information about the corresponding media item. In some embodiments, the plurality of representations are displayed overlappingly on top of first representative content (e.g., a hero image or video clip), the first representative content corresponding to the representation of the first media item that currently has focus in the suggested media items, such as a first media item that is currently in focus in the suggested media items, and / or text information about the corresponding media item. In some embodiments, the plurality of representations are displayed overlappingly on top of first representative content (e.g., a hero image or video clip), the first representative content corresponding to the representation of the first media item that currently has focus in the suggested media items, such as a first media item that is currently in focus in the suggested media items, and / or text information about the corresponding media item. Figure 6A As shown (e.g., the user of the electronic device optionally causes the media item to have focus via one or more navigation inputs provided to one or more input devices). The user interface optionally displays content representing the media item with current focus as a background behind the representation of the suggested media, such that when the media item with focus changes, the representative content as the background also changes accordingly, such as Figure 6A shown.

[0181] In some embodiments, based on different previous user actions associated with the suggested media items, the suggested media items are selected to be displayed in the user interface. For example, the user may have partially watched some media items so that they are included in the user interface, the user may have collected some media items so that they are included in the user interface, the user may have watched previous episodes in a television series so that the current episode / next episode is included in the user interface, etc. In some embodiments, the previous user action associated with the suggested media items has occurred on the current electronic device, and in some embodiments, the previous user action associated with the suggested media items has occurred on a different electronic device (for example, another electronic device associated with the user that the user logged in). In some embodiments, when the electronic device determines that it is no longer recommended to the user to watch a certain media item, the electronic device stops displaying the media item in the suggested media items. For example, the user has finished watching the media item, the media item is no longer available (for example, the rental has expired), etc.

[0182] In some embodiments, when multiple representations of suggested media items are displayed overlaid on the first representative content in the user interface, the electronic device receives (704) input via one or more input devices corresponding to a request to navigate among the multiple representations of suggested media items, such as Figures 6B to 6D In some embodiments, in response to receiving input corresponding to a request to navigate among multiple representations of media items (706): the electronic device converts (708) a representation of a second media item in the multiple suggested media items to have focus in place of the first media item that has focus (e.g., scrolling through the suggested media items based on the scroll input that changes the media item that has focus) and replaces (710) display of the first representative content with second representative content corresponding to the second media item, such as Figure 6D As shown (e.g., when the media item with focus changes, the background of the user interface also changes to correspond to the newly focused media item). By doing so, the electronic device improves the efficiency with which information about which media item has current focus is conveyed to the user, thereby improving user-electronic device interaction.

[0183] In some embodiments, the first representative content corresponding to the first media item includes (712) a still image corresponding to the first media item, and the second representative content corresponding to the second media item includes (714) a still image corresponding to the second media item, such as a reference image. 6A to 6DThe (e.g., preselected cover images corresponding to the first and second media items, still images corresponding to the beginning of the first and second media items, or still images corresponding to the current playback position within the partially viewed first and second media items). In some embodiments, the first representative content corresponding to the first media item includes (716) a video corresponding to the first media item, and the second representative content corresponding to the second media item includes (718) a video corresponding to the second media item (e.g., video previews (e.g., trailers) of the first and second media items, a video loop at the current playback position within the partially viewed first and second media items, etc.). By including such representative content in the context of the unified media browsing user interface, the electronic device improves the efficiency of conveying information about the content of the currently focused media item to the user, thereby improving user-electronic device interaction.

[0184] In some embodiments, after receiving input corresponding to a request to navigate among multiple representations of suggested media items, the electronic device receives (720) a second input via one or more input devices, the second input corresponding to a request to further navigate among the multiple representations of suggested media items, such as Figures 6H to 6I In some embodiments, in response to receiving a second input corresponding to a request to further navigate through the plurality of representations of suggested media items, the electronic device displays (722) in the user interface one or more representations of trending media items available on the electronic device, such as Figure 6J In some embodiments, the electronic device displays only media items that the user of the electronic device has access to, for example, because the user has purchased the media item or has subscribed to a content provider that provides access to the media item. In some embodiments, the representation of the trending media item is displayed in the user interface after receiving a second input corresponding to a request to further navigate through multiple suggested media items. By allowing the user to scroll through the suggested media items to reveal the trending media items, the electronic device improves the efficiency of conveying information about media items that the user may be interested in to the user, thereby improving the user-electronic device interaction.

[0185] In some embodiments, the first media item is included (724) in the suggested media items because a user of the electronic device has selected the first media item to include in the user interface, such as Figure 6DAs shown (e.g., the user explicitly selected the first media item to be included in the user interface). For example, the user has favorited the first media item through the canonical page for the first media item, the user has provided a long press input on the first media item to display a context menu from which the user added the first media item to the user's favorite media items (when not on the canonical page for the first media item), or the user has provided a voice command to a virtual assistant on the electronic device to "add this to my favorites" (when on the canonical page for the first media item) or "add [media item name] to my favorites" (when not on the canonical page for the first media item). In some embodiments, the second media item is included (724) in the suggested media items based on the user's previous viewing activity with respect to media on the electronic device, such as Figure 6A For example, the user of the electronic device has watched previous episodes of a television series, and the second media item is the next episode in the television series, such as Figure 6L As shown, the user of the electronic device has partially viewed the second media item, such as Figure 6A As shown, the user of the electronic device has rented / purchased a second media item, such as Figure 6G By displaying these media items in a centralized user interface, although users interact in different ways, the electronic device improves the efficiency of conveying information about media items that may be of interest to the user, thereby improving user-electronic device interaction.

[0186] In some embodiments, the second media item is part of an episodic media collection (726), such as Figure 6L In some embodiments, the episodic media collection includes (728) media items provided via a first content provider and a second content provider. In some embodiments, the second media item is provided (730) via the second content provider but not via the first content provider, such as Figure 6L In some embodiments, a second media item is selected (732) for inclusion in the suggested media items based on the user's viewing activity with respect to media items in the episodic media collection provided via the first content provider (but not via the second content provider), such as Figure 6LAs shown. For example, a user of an electronic device watched a previous media item in a collection of episodic media on the electronic device that was provided via a first media provider (e.g., the user watched a previous episode of a television series via a first media application on the electronic device that provides access to media from the first media provider), and a second media item is included in the user interface as being obtained via the second media provider because the second media item is not available via the first media provider (e.g., selecting the second media item will provide the second media item for the user to view via the second media application on the electronic device, rather than via the first media application on the electronic device). Thus, in some embodiments, the electronic device provides the user with easy access to the media, even though the media may be accessed via different media applications, thereby improving user-electronic device interaction.

[0187] In some embodiments, based on determining that access to a corresponding media item in the suggested media items will expire (e.g., lease expiration, availability via a streaming service expiration, etc.) within a predetermined time period (e.g., twelve hours, one day, three days, etc.), the electronic device prioritizes (734) displaying a representation of the corresponding media item among representations of the suggested media items based on the upcoming expiration of access to the corresponding media item, such as Figure 6Q In some embodiments, if access to the corresponding media item does not expire within a predetermined time period, the electronic device does not prioritize displaying a representation of the corresponding media item; for example, the corresponding media item is optionally displayed in the list of suggested media items, but outside the front of the list (e.g., the position of the representation of the second media item in the representation of suggested media items is selected based on the upcoming expiration of access to the second media item), such as Figure 6P shown.

[0188] In some embodiments, based on determining that a corresponding media item in the suggested media items is a new episode (e.g., a newly released episode of a television series, miniseries, etc.) in a collection of episodic media that a user of the electronic device has been watching (e.g., the user has watched one or more previous episodes of the episodic media collection), and the user has not yet watched the new episode, the electronic device prioritizes (736) displaying a representation of the corresponding media item in representations of the suggested media items based on the recency of the user's right to access the corresponding media item, such as Figure 6N, the corresponding media item is optionally not displayed in the priority area of ​​the user interface; for example, the corresponding media item is optionally displayed in the list of suggested media items, but if the user has partially watched the corresponding media item, it is displayed outside the front of the list, or if the user has finished watching the corresponding media item, it is not displayed at all. For example, the position of the representation of the second media item in the representation of the suggested media items is selected based on the recency with which the user has become entitled to access the second media item (for example, because the episode has just been published on a content provider to which the user has a valid subscription). By prioritizing the display of representations of certain media items based on time considerations, the electronic device more effectively communicates the availability of the media items to the user, thereby improving the efficiency with which such information is communicated to the user.

[0189] In some embodiments, based on determining (738) that the user of the electronic device has partially viewed the first media item, the first representative content corresponding to the first media item includes a visual indicator of the playback progress of the first media item, such as Figure 6A In some embodiments, based on determining (740) that the user of the electronic device has partially viewed the second media item, the second representative content corresponding to the second media item includes a visual indicator of the playback progress of the second media item (e.g., if the user has partially viewed the media item with the current focus, the background of the user interface includes a progress bar or other indicator indicating how much of the media the user has viewed). If the user has not partially viewed the media item with the current focus, the background optionally does not include such an indicator, such as Figure 6D By including such an indicator in the background of the user interface, the electronic device more effectively conveys media item information to the user, thereby improving the efficiency of conveying such information to the user.

[0190] In some embodiments, the first representative content corresponding to the first media item includes (742) information indicating why the first media item is included in the suggested media items, and the second representative content corresponding to the second media item includes (744) information indicating why the second media item is included in the suggested media items, such as Figures 6A to 6GAs shown (e.g., the background optionally displays information about why the media item with the current focus is included in the suggested content by the electronic device). For example, the background optionally indicates that the user has collected the media item, the user has partially watched the media item, the user has watched other media related to the media item, and so on. For example, for partially watched media items, the information includes "Continue" and optionally includes playback progress information. For collected media items, the information includes "Collected" and optionally the total play time. For purchased media items, the information includes "Purchased" and optionally includes the total play time. For rented media items, the information includes "Rented" and optionally includes the total play time, the time when the rental expires (e.g., expires in 20 days) and / or playback progress information. For purchased media items, the information includes "Purchased" and optionally includes the total play time. For media items corresponding to the next episode in an episodic media collection, the information includes "Next Episode" and, optionally, includes an indication of the position of the media item in the episodic media collection (e.g., Season 5, Episode 2). For a media item corresponding to a newly available episode in an episodic media collection, the information includes "New Episode" and, optionally, an indication of the location of the media item in the episodic media collection (e.g., Season 5, Episode 2). For a media item corresponding to a media item that will be removed from a subscription service, the information includes "Expiring Soon" and, optionally, an indication of when the media item will be removed from the subscription service (available until October 30). For a media item corresponding to an unavailable next episode in an episodic media collection that the user has not purchased or subscribed to, the information includes "Next Episode" and an indication that the user does not have the rights to play the media item (e.g., purchase or subscription). By including such information in the context of the user interface, the electronic device more effectively communicates media item information to the user, thereby improving the efficiency of communicating such information to the user.

[0191] In some embodiments, the first representative content corresponding to the first media item includes (746) information indicating the source of the first media item, and the second representative content corresponding to the second media item includes (748) information indicating the source of the second media item, such as Figures 6A to 6G (e.g., the background optionally displays information about the source of the media item with the current focus). For example, the background optionally includes a logo of a television channel that can provide the media item, an icon of a media application that can be used to obtain the media, etc. By including such information in the background of the user interface, the electronic device more effectively conveys the media item information to the user, thereby improving the efficiency of conveying such information to the user.

[0192] In some embodiments, the electronic device receives (750) input corresponding to a selection of a corresponding representation of a corresponding media item in the suggested media items via one or more input devices, such as Figure 6RIn some embodiments, in response to receiving input corresponding to selection of a corresponding representation of a corresponding media item (752), the electronic device launches (754) a media application on the electronic device corresponding to the corresponding media item (e.g., a different application than the application in which the media item is displayed, or the same application as the application in which the media item is displayed), such as Figure 6S In some embodiments, the electronic device causes playback (756) of the corresponding media item in the media application corresponding to the corresponding media item on the display, such as Figure 6S shown.

[0193] In some embodiments, the input corresponding to a request to navigate among the plurality of suggested media items corresponds to a request (758) to navigate among the plurality of suggested media items in a first direction, such as Figures 6B to 6D In some embodiments, the electronic device receives (760) via one or more input devices a second input corresponding to a request to further navigate through the plurality of suggested media items in a second direction different from the first direction, such as Figures 6H to 6I In some embodiments, in response to receiving a second input corresponding to a request to further navigate among a plurality of suggested media items, the electronic device displays (762) in the user interface one or more representations of additional suggested media items available on the electronic device, wherein representations of the additional suggested media items (e.g., items that are not in the "next" queue) are not displayed in the user interface until after the second input is received, such as Figures 6H to 6I , the second corresponding representation of the second corresponding media item in the additional suggested media items. Figure 6W In some embodiments, in response to receiving input corresponding to selection of a second corresponding representation of a second corresponding media item, the electronic device displays (766) on the display a media information page corresponding to the second corresponding media item, such as Figure 6XAs shown (e.g., optionally as a user interface for a dedicated specification page for the second corresponding media item). For example, the specification page includes information about the second corresponding media item and a selectable affordance that, when selected, causes the second corresponding media item to be played on the electronic device.

[0194] In some embodiments, when a media application corresponding to a corresponding media item is displayed on the display, the electronic device receives (768) input via one or more input devices corresponding to a request to navigate backward on the electronic device, such as Figure 6T In some embodiments, in response to receiving input corresponding to a request to navigate backward on the electronic device, the electronic device navigates backward within the media application according to the input (770), such as Figure 6U As shown (e.g., the link to the media application is a "deep" link such that when the user enters the media application to play the corresponding media item, the navigation hierarchy of the media application controls the electronic device's response to navigation input detected at the input device). However, in some embodiments, the backward navigation input received within the media application here navigates back to the user interface that displays a representation of the suggested media item, rather than navigating backward within the media application.

[0195] In some embodiments, based on a previous user action that occurred on a second electronic device that is different from the electronic device, the corresponding suggested media item is included (772) in the suggested media items, such as Figure 6Y In some embodiments, user actions on media items on the other devices cause those media items to be displayed among the suggested media items on the current electronic device because, for example, the suggested media items are associated with a user account of a user who is logged into multiple electronic devices, including the current electronic device and the second electronic device. In some embodiments, a media application that can be used to provide the corresponding suggested media items is not installed (774) on the electronic device, such as Figure 6Y In some embodiments, the corresponding media application that can be used to provide the corresponding suggested media item is installed on the second electronic device. Displaying the corresponding suggested media item allows the user to discover the existence of the corresponding suggested media item and provides the user with an opportunity to install the media application to view the corresponding suggested media item, thereby improving user-electronic device interaction.

[0196] In some embodiments, the electronic device receives (776) input corresponding to a selection of a corresponding representation of a corresponding suggested media item via one or more input devices, such as Figure 6Z In some embodiments, in response to receiving input corresponding to a selection of a corresponding representation of a corresponding suggested media item, the electronic device displays a prompt on the display to install the corresponding media application on the electronic device, such as Figure 6AA as shown (eg, because a media application for viewing the corresponding media item is not installed on the electronic device, selecting the corresponding media item for playback prompts the user to install a media application for viewing the corresponding media item).

[0197] In some embodiments, the electronic device receives (778) via one or more input devices an input sequence corresponding to input to install the corresponding media application on the electronic device and authorize the corresponding media application on the electronic device, such as Figures 6BB to 6DD In some embodiments, after the corresponding media application is installed and authorized on the electronic device, the electronic device begins to play back (780) the corresponding media item on the display without further user intervention, such as Figure 6EE As shown (e.g., after installation and logging in or registering with a media application, the electronic device immediately begins playing back the media item in the media application, rather than displaying a navigation or initial launch user interface for the media application, such as a home screen for the media application). Thus, after installing and authorizing the corresponding media application, no further user action is optionally required before the corresponding media item is played on the electronic device. This result simplifies the user's experience of viewing media items when the media application first needs to be installed, thereby improving user-electronic device interaction.

[0198] In some embodiments, the electronic device receives (782) input via one or more input devices corresponding to a first action regarding a corresponding media item that is not included in the suggested media items, such as Figure 6GG In some embodiments, after receiving input corresponding to a first action with respect to the corresponding media item, the electronic device displays (784) on the display a user interface that includes multiple representations of suggested media items (e.g., after taking the first action with respect to the corresponding media item, the user redisplays a media navigation user interface of a media browsing application), the multiple representations of suggested media items including a representation of the corresponding media item, such as Figure 6HHas shown (eg, the corresponding media item becomes a suggested media item due to a user's action with respect to the corresponding media item).

[0199] In some embodiments, while displaying the user interface on the display, the electronic device receives (786) input via one or more input devices to enable a private media browsing mode on the electronic device, such as Figure 6II In some embodiments, in response to receiving input (788) to enable private media browsing mode on the electronic device, the electronic device enables (790) private media browsing mode on the electronic device and replaces (792) the plurality of representations of suggested media items in the user interface with a second plurality of representations of second suggested media items that were not selected for inclusion in the user interface based on a previous user action associated with the media items, such as Figure 6II For example, in the private media browsing mode, the electronic device may not provide the user with suggested media items that are selected based on the user's media viewing activity and / or specific to the user. Instead, the electronic device may provide suggested media items that are popular with other viewers (e.g., trending media items) or media items that are otherwise selected by a third party, such as Figure 6II shown.

[0200] In some embodiments, when the private media browsing mode is enabled on the electronic device, the electronic device receives (794) via one or more input devices a second input corresponding to the first action regarding a second corresponding media item that is not included in the suggested media items, such as Figure 6JJ In some embodiments, after receiving the second input, the electronic device receives (796) an input via one or more input devices to disable the private media browsing mode on the electronic device, such as Figure 6LL In some embodiments, in response to receiving input (798) to disable the private media browsing mode on the electronic device, the electronic device disables (798-2) the private media browsing mode on the electronic device and redisplays (798-4) the plurality of representations of suggested media items in the user interface, the plurality of representations of the suggested media items not including a representation of the second corresponding media item, such as Figure 6LL (When the electronic device is in the private media browsing mode, the electronic device optionally does not track the user's media viewing actions.) For example, even if the user has taken an action with respect to the second corresponding media item that would otherwise cause the second corresponding media item to be included in the suggested media items in the media browsing application, the electronic device will not include the second corresponding media item in the suggested media items because the user took the action while the electronic device was in the private media browsing mode.

[0201] In some embodiments, when the private media browsing mode is enabled on the electronic device, the electronic device receives (798-6) input via one or more input devices to disable the private media browsing mode on the electronic device, such as Figure 6LL In some embodiments, in response to receiving input (798-8) to disable private media browsing mode on the electronic device, the electronic device disables (798-10) the private media browsing mode on the electronic device and redisplays (798-12) multiple representations of suggested media items in the user interface, such as Figure 6LL As shown (e.g., when the private media browsing mode is disabled, the electronic device optionally returns to displaying suggested media items to the user that are selected based on the user's media viewing activities and / or specific to the user). This private media browsing functionality of the electronic device allows the user to browse and view media items on the electronic device without the electronic device undesirably tracking these activities, thereby improving user-electronic device interaction.

[0202] It should be understood that Figures 7A to 7L The specific order in which the operations are described in the description is merely exemplary and is not intended to indicate that the described order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 900, 1100, 1300, and 1900) are also applicable in a similar manner to the details of the processes described above in conjunction with Figures 7A to 7L Method 700 is described. For example, the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described above with reference to method 700 may optionally have one or more of the features of the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described herein with reference to other methods described herein (e.g., methods 900, 1100, 1300, and 1900). For the sake of brevity, these details are not repeated here.

[0203] The operations in the above information processing method can be optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (for example, as described above in conjunction with Figure 1A 、 Figure 3 、 Figure 5A and Figure 14 In addition, the above reference Figures 7A to 7L The operation is optionally performed by Figure 1A to Figure 1B. For example, the display operation 702, the receiving operation 704, the conversion operation 708, and the replacement operation 710 are optionally implemented by the event classifier 170, the event identifier 180, and the event handler 190. The event monitor 171 in the event classifier 170 detects contact on the touch-sensitive surface 604, and the event distributor module 174 transmits the event information to the application 136-1. The corresponding event identifier 180 of the application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact at the first position on the touch-sensitive surface corresponds to a predefined event or sub-event, such as the selection of an object on the user interface. When the corresponding predefined event or sub-event is detected, the event identifier 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally utilizes or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know how to update the content displayed by the application based on the GUI updater 178. Figure 1A to Figure 1B The components depicted in the figure implement other processes.

[0204] Category-based media browsing

[0205] Users interact with electronic devices in a variety of different ways, including interacting with media (e.g., music, movies, etc.) available (e.g., stored or otherwise accessible) on the electronic device (e.g., as referenced in Figures 6A to 6LL 、 Figures 8A to 8GG 、 Figures 10A to 10Z 、 Figures 12A to 12V and / or Figures 18A to 18J (as described above). For example, a user can browse and play media accessible on an electronic device. The user may wish to browse such media by category (e.g., movies, television programs, etc.). The embodiments described below provide ways for an electronic device to facilitate browsing of media items by category, thereby enhancing the user's interaction with the electronic device. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, this person is optionally referred to as a user of the device.

[0206] Figures 8A to 8GG The electronic device according to some embodiments of the present disclosure facilitates browsing of media items by category. The embodiments in these figures are used to illustrate the process described below, including reference to 9A to 9H The process described.

[0207] Figure 8AAn exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 8A In the example shown, the display 514 displays a message on the electronic device (e.g., Figure 5A The unified media browsing application (e.g., as referenced in FIG. 5 ) running on the electronic device 500 Figures 6A to 6LL The unified media browsing application described above), the display 514 is a part of the electronic device, or the display 514 is connected to the electronic device. Figure 8A , the unified media browsing application displays a unified media browsing user interface 802 for browsing various media accessible on the electronic device. The user interface 802 includes selectable user interface elements 804-1 to 804-4 in a top menu bar, which are used to navigate in the unified media browsing application, as will be described in more detail below. Figures 6A to 6LL As described, in some embodiments, after selecting one of the user interface elements 804 (e.g., within a predetermined time after the selection), the electronic device stops displaying the top menu bar. Figure 8A , user interface element 804-1 corresponding to a suggested media item is currently selected (indicated by a dashed border), and the electronic device is displaying representations 806-1 through 806-6 of suggested media items and representations 815-1 through 815-4 of trending media items (e.g., as shown in FIG. Figures 6A to 6LL The suggested media items and trending media items are shown in the figure), and the representation 815-3 corresponding to the media item K has the current focus (indicated by the dotted box within the representation 815-3). Figure 8A , representations of suggested media items 806 and representations of trending media items 815 are displayed in rows. In some embodiments, the electronic device displays only representations 806 and 815 of media items that the user of the electronic device has access to (e.g., the user has a subscription to a media provider that provides access to the media items to the electronic device, the user has purchased the media items, etc.), and does not display representations of media items that the user of the electronic device does not have access to.

[0208] In some embodiments, select Figure 8A The representation of the trending media item in causes the electronic device to display a specification page corresponding to the trending media item. Figure 8B In FIG, a click on the touch-sensitive surface 604 is detected when the representation 815-3 corresponding to the media item K has the current focus. In response, the specification page corresponding to the media item K is electronically displayed, such as Figure 8C As shown, this page includes references Figure 6X The specification page corresponding to the media item K also includes a button 808, which, when selected, causes the electronic device to play the media item K, such as Figures 8C to 8D shown.

[0209] In some embodiments, a user of the electronic device can scroll through the representations 815 of trending media items to reveal user interface elements in the user interface 802 for browsing media items by category. Figures 8E to 8H , a top-to-bottom swipe of contact 608 is detected on touch-sensitive surface 604. In response, the electronic device scrolls through representations 815 of trending media items to reveal additional trending media items (e.g., popular TV shows) in user interface 802, and ultimately displays user interface elements 812-1 through 812-4 corresponding to categories of suggested media available on the electronic device. For example, user interface elements 812 include user interface element 812-1 corresponding to movies, user interface element 812-2 corresponding to TV shows, user interface element 812-3 corresponding to news programs, and user interface element 812-4 corresponding to sports programs. Figure 8H As shown, user interface elements 812 corresponding to media categories are displayed in a row, similar to how representations 806 of suggested media items are displayed.

[0210] Selecting one of the user interface elements 812 causes the electronic device to display media items of the selected category that can be evaluated by the electronic device. Figure 8I , a click on the touch-sensitive surface 604 is detected when the user interface element 812-1 corresponding to movies has the current focus. In response, the electronic device replaces the display of the representation 815 of the trending media item and the user interface element 812 of the media category with the representations 814-1 through 814-12 of the media items in the movie category, as shown in FIG. Figure 8J In some embodiments, representations 814 of media items in the movie category are displayed in the same spatial arrangement as representations 815 of trending media items and / or user interface elements 812 of media categories (e.g., rows). Figure 8J The media item whose representation 814 is displayed in the Figures 8E to 8G The media items represented by 806 and / or 815 are displayed in the unified media browsing application so that the same media item is not displayed multiple times when the user browses the media in the unified media browsing application. Figure 8J As shown, in some embodiments, movie media items 814 are displayed in groups based on one or more shared characteristics (e.g., award-winning, popular, highly rated, etc.).

[0211] Similar to reference Figures 8E to 8H As shown, the user can scroll through the representations 814 of the media items in the selected category to reveal user interface elements in the user interface 802 for browsing media items by subcategories of the selected category. Figures 8K to 8L, a top-to-bottom swipe of contact 608 is detected on touch-sensitive surface 604. In response, the electronic device scrolls through representations 814 of media items in the movies category to reveal, in user interface 802, user interface elements 816-1 through 816-4 corresponding to subcategories of movie media available on the electronic device. For example, user interface elements 816 include user interface element 816-1 corresponding to feature films, user interface element 816-2 corresponding to comedies, user interface element 816-3 corresponding to mysteries, and user interface element 816-4 corresponding to action films. Figure 8L As shown, user interface elements 816 corresponding to media subcategories are displayed in rows, similar to the display of representations of suggested media items 806, representations of trending media items 815, and representations of movie media items 814. Additionally, similar to the above, selecting one of the user interface elements 816 causes the electronic device to display media items of the selected subcategory that can be evaluated by the electronic device (e.g., similar to the reference image). Figures 8I to 8J described above).

[0212] In some embodiments, the user can scroll past the representations of suggested media items 806, the representations of trending media items 815, and the user interface element 812 for browsing media items by category to reveal additional representations of suggested media items grouped together in categories (e.g., categories different from the category represented by the user interface element 812) in the user interface 802. Figures 8M to 8P , a top-to-bottom swipe of contact 608 is detected on touch-sensitive surface 604. In response, the electronic device scrolls through representations of media items 806, representations of trending media items 815, and user interface elements 812 to reveal representations 818-1 through 818-4 of music video trending media items suggested for the user in user interface 802. Figure 8P As shown, representations 818 corresponding to music video media items are displayed in a row, similar to the display of representations 806 of suggested media items, representations 815 of trending media items, and user interface elements 812 corresponding to media categories. In addition, similar to the above, selecting one of the representations 818 causes the electronic device to display a specification page for the media item corresponding to the selected representation (e.g., similar to the reference page). Figures 8B to 8C described). Figure 8Q , another top-to-bottom swipe of contact 608 is detected on touch-sensitive surface 604 to reveal additional trending media items in the documentary category of media items, similar to that described above. Additional trending media items may optionally be accessed in response to further scrolling through user interface 802.

[0213] As described above, in some cases, the electronic device displays a media category user interface element 812 for a given media category through which media items in the media category can be browsed (e.g., user interface element 812-1 for browsing movies), and in other cases, the media category user interface element 812 for a given media category is not displayed (e.g., instead, the electronic device displays representations of media items in the given media category as a row in the user interface 802 without first requiring selection of the media category user interface element 812 for browsing media items in the category (e.g., Figures 8P to 8Q In some embodiments, if there are enough (e.g., more than three, five, ten) suggested media items in a given media category, the electronic device displays a media category user interface element 812 for that media category; otherwise, the electronic device directly displays representations of those media items in the user interface 802 without grouping those suggested media items behind the corresponding user interface elements 812. For example, in Figure 8R , three suggested media items are included in the “Sports” media category. Because three media items are below the threshold number of media items (e.g., four media items) for creating user interface element 812 for the “Sports” category, the electronic device does not display the “Sports” user interface element 812, but instead displays representations 818-9 through 818-11 of the sports media items in a row in user interface 802, as shown. Figure 8R However, if the "Sports" category includes four suggested media items, such as Figure 8S As shown, the electronic device displays the user interface element 812-4 corresponding to the "Sports" category and does not display the representation of the sports media item in a row in the user interface 802, as shown in FIG. Figure 8T shown.

[0214] In some embodiments, the electronic device has the ability to enforce media restrictions (e.g., set by the user) to limit access to media with a particular content rating (e.g., R-rated, PG-13-rated, etc.). When such a media restriction is in effect, the electronic device may optionally omit the media items subject to the media restriction from its suggested media items and / or trending media items. For example, in Figure 8U In , no media restrictions are in effect (indicated by 820), and the electronic device displays a representation 815 of the trending media item in the user interface 802. Figure 8V , a media restriction has been established that limits the user's access to media rated PG-13 or lower (represented by 820). Therefore, the electronic device no longer displays representations 815-2 and 815-5 of suggested media items in the user interface 802, which correspond to media items with an R rating.

[0215] exist Figure 8W , an input has been detected selecting user interface element 804-2 corresponding to a media library. Accordingly, the electronic device displays representations 822-1 through 822-8 of media items in the media library in user interface 802. The media library optionally includes media items that a user of the electronic device has selected to include in the media library, for example, by purchasing the media items, by renting the media items, or by adding the media items to favorites, such as Figure 8W As shown. The media library is optionally Figure 8A , because the media library optionally includes media items due to explicit user actions with respect to those media items, while the suggested media items may or may not be included in the suggested media items due to explicit user actions with respect to those media items, as previously described. When the media library user interface element 804-2 is selected, the user interface 802 also includes a selectable affordance 824 for sorting the media items in the media library based on various characteristics, such as title, date the item was added to the media library, type of media item (e.g., movie, TV show, etc.), and content rating.

[0216] exist Figure 8X In FIG. 8 , an input is detected selecting user interface element 804-3, which corresponds to a media application that is not installed on the electronic device and provides access to media on the electronic device. Consequently, the electronic device displays representations 826-1 through 826-4 of the media applications that are not installed on the electronic device. For example, media application A, which provides access to media from media provider 1, is not installed on the electronic device; therefore, the electronic device displays representation 826-1 corresponding to media application A, which provided access to media from media provider 1 in user interface 802 when store user interface element 804-3 was selected. Similarly, the electronic device displays representations 826-2 through 826-4 of media applications that are not installed on the electronic device. As shown in 828 , the user of the electronic device has access to media through media providers 1, 3, and 4. Thus, some representations 826 correspond to media applications that provide the user with access to media (e.g., media applications A and C), while some representations 826 correspond to media applications that do not provide the user with access to media (e.g., media applications B-1 and B-2).

[0217] The electronic device also displays representations 830-1 and 830-2 corresponding to media subscriptions available to the user of the electronic device. For example, representation 830-1 corresponds to the media subscription of media provider 4, and representation 830-2 corresponds to the media subscription of media provider 5. Each representation 830 includes visual indications (e.g., images, videos) of the corresponding subscribed media available to the user of the electronic device (e.g., visual indications D-1 and D-2 in representation 830-1, and visual indications E-1 and E-2 in representation 830-2). These visual indications are optionally pre-selected cover images or images for the media in those subscriptions and / or video previews for the media in those subscriptions. In this way, the electronic device provides information that is easy for the user to see about the media to which the user can obtain access rights. Representation 826 can be selected to install the corresponding media application on the electronic device, and representation 830 can be selected to subscribe to the corresponding media subscription on the electronic device.

[0218] In some embodiments, the electronic device will not display representations of applications that entitle the user of the electronic device to access media (e.g., due to a subscription to a media provider corresponding to those applications), even if those media applications are not installed on the electronic device. Figure 8Y , the user has access to media through media providers 1, 3, and 4. Therefore, the electronic device does not display representations 826-1 and 826-4, which correspond to applications of media providers that the user already has access to, and does not display representation 830-1, which corresponds to a media subscription that the user already has with media provider 4.

[0219] In some embodiments, media from a given media provider may be accessed through multiple media applications. Figure 8Y , both media applications B-1 and B-2 can provide access to media from media provider 2. For example, media provider 2 can have a first application that provides access to its media based on a user's subscription to a cable TV company (e.g., indirectly subscribing to media provider 2 via the user's subscription to the cable TV company or other similar entity that has an arrangement to provide media from media provider 2 to its customers), and a second application that provides access to its media based on the user's direct subscription to media provider 2. In this case, once the user installs one of media applications B-1 and B-2, the electronic device optionally stops displaying a representation of the other media application in user interface 802. For example, in Figure 8ZIn FIG. 6 , a click on touch-sensitive surface 604 is detected when representation 826-2 corresponding to media application B-1 has front focus. In response, the electronic device downloads and / or installs media application B-1 and stops displaying representation 826-2 and representation 826-3, both of which correspond to media application B-2. Figure 8AA shown.

[0220] exist Figure 8BB , an input is detected selecting a user interface element 804-4 for the electronic device to search for accessible media. Accordingly, the electronic device displays a search interface on the display 514. The search interface includes a search field 836 for providing search criteria and displays representations 834-1 to 834-4 of media items resulting from the search. As shown in 828, the user has access to media from media providers 1, 3, and 4. In addition, the search interface includes user-configurable options for searching all media accessible to the electronic device, or for searching only those media accessible to the electronic device that the user of the electronic device has access to. Figure 8BB , the search is not limited to media that the user of the electronic device has access to (indicated by 832). Thus, in response to the search term "comedy" being entered into search field 836, the electronic device displays search result representations of media items that are accessible through Media Providers 1, 2, and 3, even though the user does not have access to media through Media Provider 2.

[0221] However, in some embodiments, the electronic device searches for media items that the user has access to, but does not search for media items that the user does not have access to. Figure 8CC , the search is limited to media that the user of the electronic device has access to (indicated by 832). Thus, in response to the search term "comedy" entered into the search field 836, the electronic device only displays representations 834-1 and 834-3 corresponding to media items from media providers 1 and 3, but does not display representations 834-2 and 834-4 corresponding to media items from media provider 2.

[0222] In some embodiments, media restrictions that restrict media playback based on content ratings may take effect while the electronic device is performing a search for media items. Figure 8DD In the example, the media restriction effectively limits playback of the media to media with a rating of PG-13 or lower (represented by 820). However, in some embodiments, the electronic device performs a search and displays a representation 834 resulting from the search regardless of the media restriction in effect. For example, in the example Figure 8DD, the electronic device displays representations 834-1 and 834-4 resulting from its search, even though these representations correspond to media items with an R rating. However, selecting these representations will not result in playback of those media items, whereas selecting search result representations corresponding to media items permitted by the media restriction will result in playback of those media items. Figure 8EE , a click on the touch-sensitive surface 604 is detected when representation 834-1 corresponding to R-rated media item A has front focus. In response, the electronic device does not play media item A but instead displays a visual indication that media item A is subject to media restrictions, such as Figure 8FF In some embodiments, if the search is limited to authorized media (by Figure 8GG 832 in the instruction), the electronic device will not display the search result representation of the media that the user of the electronic device does not have the right to view, such as Figure 8GG shown.

[0223] 9A to 9I is a flow chart illustrating a method 900 for facilitating browsing of media items by category according to some embodiments of the present disclosure. The method 900 is optionally implemented on an electronic device such as device 100, device 300, or device 500 (as described above with reference to FIG. Figure 1A to Figure 1B 、 Figures 2 to 3 as well as Figures 5A to 5B Some operations in method 900 may be optionally combined, and / or the order of some operations may be optionally changed.

[0224] As described below, method 900 provides a way to facilitate browsing media items by category. The method reduces the cognitive burden on the user when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.

[0225] In some embodiments, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) in communication with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510, or a smartphone, such as device 511) receives (902) a request to display on the display a media item suggested to a user of the electronic device, such as Figure 8AAs shown (e.g., a request to launch and display a unified media browsing application on the electronic device that displays media from different media providers and / or different media applications available on the electronic device, such as described in method 700). In some embodiments, the media displayed by the electronic device is media that the electronic device determines will be of interest to the user based on the user's previous media viewing actions. In some embodiments, in response to receiving the request to display suggested media items, the electronic device displays (904) in a media navigation user interface on the display (e.g., within a media browsing application running on the electronic device that is different from the application on the electronic device that corresponds to the media providers and provides media from those content providers) a first plurality of representations of suggested media items, such as Figure 8A In some embodiments, the representations are displayed in a row in the media navigation user interface. In some embodiments, the representations are selected to play the corresponding media item and / or display additional information about the corresponding media item, such as a video clip. Figures 8B to 8D shown.

[0226] In some embodiments, while displaying the first plurality of representations of suggested media items, the electronic device receives (906) navigation input via one or more input devices corresponding to a request to scroll through the first plurality of representations of suggested media items, such as Figures 8E to 8H In some embodiments, in response to receiving the navigation input, the electronic device scrolls (908) through a first plurality of representations of suggested media items to reveal, in a media navigation user interface, a plurality of media category user interface elements corresponding to media categories of the suggested media, wherein, prior to receiving the navigation input, the plurality of representations of the media items were displayed without displaying the media category user interface elements, such as Figures 8E to 8H In some embodiments, user interface elements corresponding to media categories are displayed in the media navigation user interface in the same spatial layout as representations corresponding to suggested media (e.g., as visual blocks in a row of visual blocks).

[0227] In some embodiments, when displaying a media category user interface element, the electronic device receives (910) input via one or more input devices selecting a corresponding media category user interface element in the plurality of media category user interfaces, such as Figure 8I In some embodiments, in response to receiving input selecting the corresponding user interface element, the electronic device replaces (912) the first plurality of representations of suggested media items and the media category user interface element in the media navigation user interface with a second plurality of representations of suggested media items that correspond to suggested media items in the corresponding media category, such as a corresponding user interface element currently selected. Figures 8I to 8J , as shown in (e.g., when a user selects a particular category of media, the media navigation user interface is updated to display representations of media corresponding to the selected media category). In some embodiments, representations of media items corresponding to the selected media category are displayed in the media navigation user interface in the same spatial layout as representations corresponding to suggested media and / or media categories (e.g., as visual blocks in a row of visual blocks). In some embodiments, the corresponding media category is a media filter, and the suggested media items that are eligible to be displayed in the second plurality of suggested media items are a subset of the suggested media items that are eligible to be displayed in the first plurality of suggested media items. In this way, the electronic device improves the user's ability to easily browse and discover media by category, thereby improving the efficiency of user-electronic device interaction. In some embodiments, the suggested media items in the corresponding media category are not included in the suggested media items (918) (e.g., the media items displayed when a certain content category is selected are optionally not displayed in the original media navigation user interface before the content category is selected). Therefore, when browsing media in the media navigation user interface, the user of the electronic device optionally does not see a given media item twice, thereby improving the efficiency of user-electronic device interaction.

[0228] While displaying the media category user interface element, the electronic device optionally receives (914) a second navigation input via one or more input devices corresponding to a request to scroll past the media category user interface element, such as Figures 8O to 8Q In response to receiving the second navigation input, the electronic device optionally scrolls (916) past the media category user interface element to reveal in the media navigation user interface a third plurality of representations of suggested media items that are different from the first and second plurality of suggested media items, such as Figures 8O to 8QAs shown (e.g., additional suggested media items are optionally displayed below the media category user interface element and / or to the left or right of the media category user interface element in the media navigation user interface). In this way, the electronic device improves the user's ability to easily browse and discover additional media by category, thereby improving the efficiency of user-electronic device interaction.

[0229] In some embodiments, based on determining that a given media category of suggested media includes greater than a threshold number of media items (e.g., five, ten, or fifteen), a media category user interface element corresponding to the given media category is included in the plurality of media category user interface elements, and representations of media items included in the given media category of suggested media are not displayed in the media navigation user interface (920), such as Figures 8S to 8T In some embodiments, based on determining that a given media category of suggested media includes less than a threshold number of media items (e.g., five, ten, or fifteen), a media category user interface element corresponding to the given media category is not included in the plurality of media category user interface elements, and representations of the media items included in the given media category of suggested media are displayed in the media navigation user interface (922), such as Figure 8R (For example, if a category does not have enough media items associated with it, the category is not shown as a category user interface element, and the media items in the category are optionally displayed in the media navigation user interface so that the user can browse these media items.) In this way, the electronic device intelligently presents media items to the user in a manner that makes them easier to browse, thereby improving the efficiency of the user-electronic device interaction.

[0230] In some embodiments, the suggested media items include media items that the user of the electronic device has permission to access on the electronic device (e.g., the user has a subscription to a media provider that provides the user with access to the media items, the user has purchased the media items, etc.), and exclude (e.g., do not include) media items that the user of the electronic device does not have permission to access on the electronic device (924) (e.g., the electronic device only suggests to the user media that the user has permission to access).

[0231] The electronic device optionally receives (926) input via one or more input devices selecting a respective representation of a respective media item in the first or second plurality of representations of suggested media items, such as Figure 8BIn response to receiving input selecting the corresponding representation of the corresponding media item, the electronic device optionally displays (928) a page corresponding to the corresponding media item on the display, the page including information about the corresponding media item and a selectable affordance that, when selected, plays the corresponding media item on the electronic device, such as Figure 8C In some embodiments, the electronic device receives (930) a selection of the selectable affordance via one or more input devices, such as Figure 8C In response to receiving a selection of the selectable affordance, the electronic device optionally plays (932) on the display a corresponding media item on the electronic device, such as Figure 8D In this way, the electronic device facilitates understanding and playing of media items on the electronic device, thereby improving the efficiency of user-electronic device interaction.

[0232] In some embodiments, the first plurality of representations of suggested media items includes representations of suggested media items displayed in corresponding areas (e.g., in rows) of the media navigation user interface that correspond to corresponding media categories (934) of the suggested media, such as Figures 8P to 8Q As shown (for example, representations of suggested media are displayed in rows corresponding to categories of the suggested media, such as popular movies, popular TV shows, genres (sports, news, etc.), application-specific content (new content on media provider 1, new content on media provider 2, etc.), golf, etc.). In this way, the electronic device improves the user's ability to easily browse and discover media by category, thereby improving the efficiency of user-electronic device interaction.

[0233] When a second plurality of representations of suggested media items corresponding to suggested media items in a corresponding media category (e.g., media items displayed after the user has selected a media category) are displayed in the media navigation user interface, the electronic device optionally receives (936) via one or more input devices a second navigation input corresponding to a request to scroll through the second plurality of representations of suggested media items, such as Figures 8J to 8LIn response to receiving the second navigation input, the electronic device optionally scrolls (938) through the second plurality of representations of suggested media items to display a second plurality of media category user interface elements corresponding to media subcategories of the corresponding media category (e.g., media category user interface elements corresponding to other media categories within the selected media category) in the media navigation user interface, wherein, prior to receiving the second navigation input, the second plurality of representations of the suggested media items are displayed without displaying the second plurality of media category user interface elements, as shown in FIG. Figures 8J to 8L (e.g., if movies is the selected category, further filtering by genre; if TV shows is the selected category, further filtering by genre; if kids is the selected category, further filtering by age range; etc.). In this way, the electronic device improves the user's ability to easily browse and discover media by category, thereby improving the efficiency of user-electronic device interaction. In addition, displaying suggested content before displaying category filter options provides the user with a content-first experience that increases the number of playable media items displayed on the display and reduces the number of inputs from the user before the user selects a playable media item for playback, thereby improving the efficiency of device usage.

[0234] In some embodiments, based on determining that a media restriction is in effect for the electronic device (e.g., a parental restriction, or other restriction that prevents viewing of media with a particular content rating, such as a movie rated R or higher), the suggested media items corresponding to the first plurality of representations and the second plurality of representations of suggested media items exclude (e.g., do not include) media items that are subject to the media restriction (940), as shown in FIG. Figure 8V (For example, if media restrictions are in place, the media displayed in the media navigation user interface is limited to the media allowed by the media restrictions.) Therefore, in some embodiments, the user can browse only the media allowed by the media restrictions. In this way, the electronic device improves the user's ability to easily browse and discover unrestricted media, thereby improving the efficiency of the user-electronic device interaction.

[0235] When media restrictions are in effect on the electronic device, the electronic device optionally receives (942) input via one or more input devices corresponding to a request to perform a search across media items accessible to the electronic device, such as Figure 8DD In response to receiving an input corresponding to a request to search across media items accessible to the electronic device, the electronic device optionally searches (944) the media items accessible to the electronic device, including media items subject to media restrictions, such as Figure 8DD (e.g., even when media restrictions are in effect, searches performed on the electronic device will search all media accessible to the electronic device regardless of the media restrictions.) In some embodiments, searching for media items accessible to the electronic device includes searching for media items that the user of the electronic device has permission to access on the electronic device without searching for media items that the user of the electronic device does not have permission to access on the electronic device (946), such as Figure 8CC (e.g., searching for media across media regardless of media restrictions, but only searching for media that the user has permission to view). Thus, the electronic device allows the user to discover media that is restricted and / or authorized by media restrictions, thereby improving the user's ability to discover authorized media on the electronic device and improving the efficiency of user-electronic device interactions.

[0236] The electronic device optionally receives (948) via one or more input devices an input corresponding to a request to play a search result media item resulting from a search for a media item (e.g., a selection of a search result media item after the electronic device displays the search result media item in response to a media search performed by a user) while the media restrictions are in effect on the electronic device, wherein the search result media item is subject to the media restrictions on the electronic device, such as Figure 8EE In response to receiving a request to play the search result media item, the electronic device optionally displays (950) a visual indication on the display that the search result media item is subject to the media restriction on the electronic device, without playing the search result media item on the electronic device, such as Figure 8FF (For example, if a user selects a restricted media item in the search results to play, the electronic device displays a warning that the media item is restricted and does not play the media item.) In this way, the electronic device improves the user's ability to determine whether media is restricted and / or that media restrictions are in place, thereby improving the efficiency of user-electronic device interaction.

[0237] In some embodiments, the media navigation user interface also includes a library user interface element corresponding to a media library (e.g., a collection of media items) that includes media items that a user of the electronic device has selected for inclusion in the media library (952), such as Figure 8W) (e.g., media items that the user has favorited (or otherwise designated for inclusion in the media library), purchased, rented). The media library is optionally a collection of media items that is different from suggested media items, because the media library optionally includes media items as a result of explicit user actions with respect to those media items, while suggested media items may or may not be included in the suggested media items as a result of explicit user actions with respect to those media items. In some embodiments, the electronic device receives (954) input via one or more input devices selecting a library user interface element (e.g., a click on a button on the input device while the library user interface element has focus). In response to receiving the input selecting the library user interface element, the electronic device optionally replaces (956) the representation of the suggested media items in the media navigation user interface with a plurality of representations of media items that the user of the electronic device has selected for inclusion in the media library, such as Figure 8W In some embodiments, the media library includes one or more optional affordances for categorizing the media library by title, date, etc. Thus, the electronic device provides an interface that allows the user to easily browse the media specified for inclusion in the media library, thereby improving the efficiency of user-electronic device interaction.

[0238] In some embodiments, the media navigation user interface also includes a store user interface element that corresponds to a media application that provides media that the user of the electronic device does not have permission to view (958), such as Figure 8X In some embodiments, the electronic device receives (960) input via one or more input devices selecting a library store user interface element (e.g., a click on a button on an input device while the store user interface element has focus). In response to receiving the input selecting the store user interface element, the electronic device optionally replaces (962) the representation of the suggested media items in the media navigation user interface with a plurality of representations of media applications that provide media that the user of the electronic device does not have permission to view, such as Figure 8X In some embodiments, multiple representations of media applications are displayed, but representations of media applications through which the user of the electronic device has the right to access media (964) are not displayed, such as Figure 8Y In this way, the electronic device provides the user with quick access to media applications that are not installed on the electronic device and / or through which the user does not have permission to access media, thereby improving the efficiency of user-electronic device interaction.

[0239] In some embodiments, the representations of the media applications include one or more representations corresponding to media subscriptions available to a user of the electronic device (e.g., subscriptions to applications on which media is available, such as Media Provider 1, Media Provider 2), wherein the respective representations corresponding to the respective media subscriptions available to the user include respective visual indications of the media that will be accessible to the user via the respective media subscriptions (966), as shown in FIG. Figure 8X ) (e.g., a representation of a media subscription includes an indication of the media that the user will have access to if the user subscribes to the media subscription). For example, a representation of media provider 1 optionally includes graphics of programs available from media provider 1, a representation of media item 2 optionally includes graphics of programs available from media provider 2, and so on. In this way, the electronic device provides readily accessible information about media that the user can access via a subscription to a given media provider, thereby improving the efficiency of user-electronic device interactions.

[0240] In some embodiments, a user of an electronic device has a subscription to a media provider that provides the user with access to media via a plurality of media applications, the plurality of media applications including a first set of media applications that are not installed on the electronic device (968), such as Figure 8Y (e.g., the user is a customer of a cable company and the user's account with the cable company allows the user to view media from multiple media applications (e.g., an application for a first media provider, an application for a second media provider, etc.). In some embodiments, multiple representations of media applications are displayed, but representations of media applications in the first set of media applications (970) are not displayed, such as Figure 8Y (e.g., even if a first set of media applications is not installed on the electronic device, the first set of media applications is optionally not displayed in the store user interface because the user already has rights to access content via those applications due to the user's account with the cable company. In this way, the electronic device does not display information that may not be of interest to the user of the electronic device (e.g., representations of media applications through which the user already has rights to access media), thereby improving the efficiency of user-electronic device interactions.

[0241] In some embodiments, a plurality of corresponding provider media applications provide access to media items from corresponding media providers, the media applications including a first media application that provides access to media items from the corresponding media provider and a second media application that provides access to media items from the corresponding media provider (972), such as Figures 8X to 8Z, as shown in (e.g., a given media provider has multiple media applications that can provide access to media on the media provider). For example, a media provider may have a first application that provides access to media based on a user's subscription with a cable TV company (e.g., the user indirectly subscribes to the media provider via the user's subscription with the cable TV company) and a second application that provides access to media based on the user's direct subscription with the media provider. In some embodiments, the first media application is installed on an electronic device, and the user of the electronic device has a subscription to the first media application to provide access to media items from the corresponding media provider (974), as shown in . Figures 8Y to 8Z In some embodiments, the second media application is not installed on the electronic device (976), such as Figures 8Y to 8Z (e.g., no other media application is downloaded, installed, and / or authenticated on the electronic device for accessing media from the media provider). In some embodiments, multiple representations of media applications are displayed, but the second media application is not displayed (978), such as Figure 8Z (e.g., even if some media applications for accessing media from a given media provider are not installed on the electronic device, they are optionally not displayed in the store user interface because the user has already installed and authenticated other media applications for accessing media from the given media provider.) In some embodiments, multiple representations of media applications are displayed without displaying any representations of multiple corresponding provider media applications. In this way, the electronic device does not display information that may not be of interest to the user of the electronic device (e.g., representations of duplicate media applications), thereby improving the efficiency of user-electronic device interaction.

[0242] In some embodiments, the media navigation user interface also includes a search user interface element for searching for media accessible to the electronic device (980), such as Figure 8BB In some embodiments, the electronic device receives (982) input via one or more input devices selecting a library search user interface element (e.g., a click on a button on the input device while the search user interface element has focus). In response to receiving the input selecting the search user interface element, the electronic device optionally replaces (984) the representation of suggested media items in the media navigation user interface with a search interface for searching media accessible to the electronic device, the search interface including a user-configurable option for searching only media accessible to the electronic device or only media accessible to the electronic device and to which the user of the electronic device has access, such as Figure 8BBIn some embodiments, the search from the search interface is performed while media restrictions are in effect for the electronic device, as previously described (e.g., as described in step 942). In such embodiments, such a search may optionally search all media accessible to the electronic device, regardless of the media restrictions, such as Figure 8DD and as shown in step 942. In some embodiments, if the user attempts to play a media item found through the search that is subject to a media restriction (e.g., as described in step 948), the electronic device displays a warning that the media item is restricted and does not play the media item, as previously described. Figure 8FF and as shown in step 950.

[0243] It should be understood that 9A to 9I The specific order in which the operations are described in the description is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 700, 1100, 1300, and 1900) are also applicable in a similar manner to the details of the processes described above in conjunction with 9A to 9I Method 900 is described. For example, the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described above with reference to method 900 may optionally have one or more of the features of the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described herein with reference to other methods described herein (e.g., methods 700, 1100, 1300, and 1900). For the sake of brevity, these details are not repeated here.

[0244] The operations in the above information processing method can be optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (for example, as described above in conjunction with Figure 1A 、 Figure 3 、 Figure 5A and Figure 15 In addition, the above reference 9A to 9I The described operation is optionally performed by Figure 1A to Figure 1B6 and 7. For example, receiving operations 902, 906, and 910, displaying operation 904, scrolling operation 908, and replacing operation 912 are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. Event monitor 171 in event classifier 170 detects contact on touch-sensitive surface 604, and event distributor module 174 transmits the event information to application 136-1. A corresponding event recognizer 180 of application 136-1 compares the event information with a corresponding event definition 186 and determines whether a first contact at a first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on a user interface. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates an event handler 190 associated with the detection of the event or sub-event. Event handler 190 optionally utilizes or calls data updater 176 or object updater 177 to update application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know how to update the content displayed by the application based on the GUI updater 178. Figure 1A to Figure 1B The components depicted in the figure implement other processes.

[0245] Unified media browsing application settings

[0246] Users interact with electronic devices in many different ways, including interacting with media (e.g., music, movies, etc.) available (e.g., stored or otherwise accessible) on the electronic device. For example, a user may browse and play media accessible on the electronic device (e.g., as described in the referenced media browsing application) in a unified media browsing application. Figures 6A to 6LL 、 Figures 8A to 8GG 、 Figures 10A to 10Z 、 Figures 12A to 12V and / or Figures 18A to 18J As described above). However, in some cases, in order to be able to browse media from different media applications in a unified media browsing application, authorization from the user may be required to allow the corresponding media providers to share user-specific information (e.g., information related to the user's actions with respect to the media on those media providers) with the unified media browsing application. The embodiments described below provide a way for an electronic device to facilitate the setting of a unified media browsing application, thereby enhancing the user's interaction with the electronic device. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, this person is optionally referred to as a user of the device.

[0247] Figures 10A to 10ZThe embodiments in these figures are used to illustrate the process described below, including reference to Figures 11A to 11F Describe the process.

[0248] Figure 10A An exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 8A In the example shown, the display 514 displays the electronic device (e.g., Figure 5A The home screen user interface 1005n of the electronic device 500 of the embodiment of the present invention is a display 514 that is part of the electronic device or that is connected to the electronic device. The user interface 1005 is optionally an application browsing user interface of the operating system of the electronic device, which includes icons for different applications installed on the electronic device, which can be selected to start their corresponding applications on the electronic device. For example, the user interface 1005 includes icons 1018-1 to 1018-5, which can be selected to start different applications on the electronic device. Icon 1018-1 can be selected to start the unified media browsing application (for example, reference Figures 6A to 6LL The unified media browsing application described above), icon 1018-2 may be selected to launch a settings application (e.g., a settings application may be optionally accessed through the settings application). Figure 10Q In the settings user interface 1003 in FIG, icon 1018-3 may be selected to launch the media application corresponding to media provider 1, icon 1018-4 may be selected to launch the media application corresponding to media provider 2, and icon 1018-5 may be selected to launch the media application corresponding to media provider 3. Figure 10K , icon 1018-3 has current focus, as indicated by the dashed box within icon 1018-3.

[0249] User interface 1005 also includes an area above icons 1018 (e.g., a "top-level" area) that optionally displays one or more user interface elements corresponding to the application whose icon 1018 has current focus. Figure 10A, icon 1018-3 corresponding to media provider 1 has current focus. Therefore, the electronic device displays representations 1023-1 to 1023-4 of media items accessible from media provider 1 in the "top level" area of ​​user interface 1005. Representation 1023 optionally includes information identifying each media item (e.g., text information) and / or information about the content of each media item (e.g., a video preview of the media item, a still image of the media item, etc.). In some embodiments, the "top level" area is a scrollable area that includes representations of suggested media items for the application currently highlighted in the home screen, and swiping upward moves the current focus to a representation of one of the suggested media items, which, upon selection of the representation (e.g., by a tap or click input on a remote control), causes the device to begin playing the media item corresponding to the representation of the suggested media item with current focus.

[0250] exist Figure 10B , a right-to-left swipe contact 608 is detected on touch-sensitive surface 604, which causes icon 1018-1 corresponding to the unified media browsing application to have current focus. As a result, the electronic device displays user interface elements 1020-1 and 1020-2 corresponding to the unified media browsing application in the "top level" area of ​​user interface 1005. Figure 10L In the embodiment of the present invention, the unified media browsing application has not yet been authorized to act as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device (e.g., as will be described later). Therefore, user interface element 1020 is an information item related to the unified media browsing application and is not a representation of a media item that can be browsed in the unified media browsing application once authorized. Specifically, for example, user interface element 1020-1 is a video (or a link to a video) that describes how to set up the unified media browsing application, and user interface element 1020-2 is a video (or a link to a video) that describes how to use the unified media browsing application. When the unified media browsing application has the current focus, swiping upward causes the current focus to move to a representation of one of the information items related to the unified media browsing application. After selecting the representation (e.g., by a tap or click input on a remote control), the device will start playing a media item (e.g., a demonstration video) corresponding to the information item related to the unified media browsing application with the current focus.

[0251] exist Figure 10B , after detecting a swipe contact 608 from right to left on the touch-sensitive surface 604, a click is detected on the touch-sensitive surface 604, thereby selecting representation 1018-1. As a result, the electronic device launches and displays the unified media browsing application, such as Figure 10C As shown. Figure 10C , the unified media browsing application has not been authorized to act as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device to facilitate users of the electronic device to easily browse and view those media items. Therefore, the user interface 1002 displayed by the unified media browsing application includes a button 1007 for setting and / or authorizing the unified media browsing application to do so. In addition, the user interface 1002 includes information items 1006 and 1008 related to the unified media browsing application. Specifically, the user interface 1002 includes item 1006 (a video (or a link to a video) describing how to set up the unified media browsing application) and item 1008 (a video (or a link to a video) describing how to use the unified media browsing application). Item 1008 has Figure 10C , and button 1007 and items 1006 and 1008 are overlaid on a background image / video corresponding to a "how to use" video corresponding to item 1008, as shown in FIG. Figure 10C Prior to setting up / authorizing the unified browsing media application, in some embodiments, the user interface 1002 does not include representations of media available from the various media applications installed on the electronic device. However, in some embodiments, the user interface 1002 includes a partial representation of trending media items (e.g., popular movies), such as Figure 10C shown.

[0252] exist Figure 10D In FIG, a swipe contact 608 from left to right is detected on the touch-sensitive surface 604 to move the current focus to the button 1007, and a click on the touch-sensitive surface 604 is detected when the button 1007 has the current focus. In response, the electronic device initiates a process for allowing browsing of media available from various media applications installed on the electronic device in the unified media browsing application. For example, Figure 10E As shown, in response to Figure 10D1010-3. The electronic device displays a dialog box 1012 that includes a row of representations 1010-1 to 1010-3 of media providers 1, 2, and 3. Representation 1010 corresponds to a media provider, and after setting / authorizing the unified media browsing application, media from the media provider can be browsed in the unified media browsing application. Representation 1010 is optionally a text and / or graphic representation of the media provider (e.g., a logo of the media provider, an icon of the media application corresponding to the media provider, etc.). If the list of media providers is very long (e.g., longer than a threshold value (such as five, ten, or fifteen)), this row of representations 1010 is animated into horizontal scrolling to automatically display all representations 1010 over time. In addition or alternatively, dialog box 1012 includes a "View All" button 1015 that can be selected to expand dialog box 1012, thereby displaying all media providers to be added to the unified media browsing application in the grid of representation 1010. In some embodiments, the multiple representations 1010 of applications correspond to applications associated with a user account of the user on the electronic device, such as applications downloaded on an electronic device logged into the user account, or applications downloaded on other electronic devices that are also associated with the user account (e.g., logged into the user account). In some embodiments, the multiple representations 1010 of applications correspond to applications that are downloaded on the electronic device and into which the user is logged in (e.g., the user has provided access credentials to the application so that the application provides access to its corresponding media). Dialog box 1012 also includes a button 1014 that can be selected to authorize the media provider corresponding to the representation 1010 to share user-specific information (e.g., information related to actions performed by the user with respect to media on those media providers, such as media purchasing activities, media rental activities, media collection / bookmarking activities, media viewing activities, etc.) with the unified media browsing application.

[0253] exist Figure 10F , a click on the touch-sensitive surface 604 is detected when button 1014 has current focus. As described above, selection of button 1014 provides authorization for media providers 1, 2, and 3 (corresponding to representation 1010) to share user-specific information with the unified media browsing application. After receiving the above authorization, the unified media browsing application stops displaying FIG. 10C to FIG. 10D , and begins displaying representations of media items accessible from media providers 1, 2, and 3. For example, Figure 10GAs shown, user interface 1002 now includes representations 1004-1 to 1004-6 of various media items accessible from media providers 1, 2, and 3. Initially, after authorizing the unified media browsing application as described above, representation 1004 optionally corresponds to trending media items (e.g., media items that were not selected for inclusion in user interface 1002 based on the viewing activity of the user of the electronic device, such as popular television programs). For example, trending media items may alternatively be media items that are popular with other viewers, or may be media items that are additionally selected by a third party (e.g., media items that were selected by a media provider to be included in user interface 1002 to promote the media items). When the user of the electronic device takes an action with respect to media items accessible on the electronic device (e.g., views a media item, rents a media item, purchases a media item, etc.), the media items selected for inclusion in user interface 1002 based on the user's viewing activity will replace the trending media items in user interface 1002, as will be described in more detail below.

[0254] As an alternative to selecting button 1007 to set up and authorize the unified media browsing application, selecting a representation of a media item in the unified media browsing application optionally also triggers the setup / authorization of the unified media browsing application. Figures 10H to 10I , a downward swipe contact 608 is detected on the touch-sensitive surface 604, and as a result, the electronic device scrolls through the user interface 1002 and causes representation 1004-11 corresponding to the popular television show to have current focus. Figure 10J In the example, the selection of representation 1004-11 is detected. In response, the electronic device displays a dialog box 1012, such as Figure 10K As shown, and after authorization, the unified media browsing application is displayed, as Figure 10L As described above, media items selected for inclusion in user interface 1002 based on the user's viewing activity will replace Figure 10L The trending media items in the user interface 1002 in , as will now be described.

[0255] For example, in Figure 10M , the electronic device plays media item B in a media application corresponding to media provider 3 via media provider 3 (e.g., in response to user input for viewing media item B). After media item B is partially viewed on the electronic device, representation 1005-1 corresponding to media item B from media provider 3 is included in user interface 1002, as shown in FIG. Figure 10N Specifically, the representation 1004-6 of the trending media item L (in Figure 10L) has been removed from user interface 1002 (e.g., pushed away from the edge of user interface 1002), and representation 1005-1 of media item B, which the user partially viewed, has been added to user interface 1002. As additional representations of media items are added to user interface 1002 due to the user's viewing activity, additional representations of trending media items will similarly be replaced in user interface 1002. For example, in Figure 10O , the electronic device plays media item A in a media application corresponding to media provider 2 via media provider 2 (e.g., in response to user input for viewing media item A). After media item A is partially viewed on the electronic device, a representation 1005-2 corresponding to media item A from media provider 2 is included in user interface 1002, as shown in FIG. Figure 10P As shown, another representation of the trending media item in user interface 1002 (e.g., representation 1004-5 of trending media item K) is replaced. In some embodiments, even after the "next" content selected based on the user's activity with respect to the content has pushed the trending content off the screen, the user can scroll through the next content (e.g., by swiping right on the touch-sensitive surface) to redisplay the trending content on the display and scroll the "next" content off the display. In some embodiments, the trending content changes based on the aggregated activity of multiple users (e.g., the trending content indicates content that a large number of users viewed within a predetermined time period (such as the past hour, day, week, or month)).

[0256] In some embodiments, the electronic device provides a settings user interface for individually managing the authorization of each media provider to share user-specific information with the unified media browsing application. Figure 10Q In the example, user interface 1003 is such a setting user interface. User interface 1003 can be a user interface of the unified media browsing application itself, or a user interface of an operating system of an electronic device outside the unified media browsing application. User interface 1003 enables the user to individually authorize or unauthorize media providers 1, 2, and 3 to share user-specific information with the unified media browsing application. For example, in Figure 10Q In the example, the user interface 1003 includes a switch 1016-1, a switch 1016-2, and a switch 1016-3. The switch 1016-1 is used to authorize or cancel the authorization of the media provider 1 to share user-specific information with the unified media browsing application (in the example). Figure 10Q The switch 1016-2 is used to authorize or cancel the authorization of the media provider 2 to share user-specific information with the unified media browsing application (in Figure 10Q The switch 1016-3 is used to authorize or cancel the authorization of the media provider 3 to share user-specific information with the unified media browsing application (in Figure 10QThe user interface 1003 may also optionally include a switch 1016-4 and a button 1017, wherein the switch 1016-4 is used to enable or disable the private media browsing mode on the electronic device (in Figure 10Q ), as referenced Figures 6FF to 6LL As depicted, selecting button 1017 optionally deletes all user data related to media viewing activity on the electronic device.

[0257] Figure 10R The home screen user interface 1005 of the electronic device is shown. In response to input detected on the remote control corresponding to a request to navigate back to the home screen user interface 1005, the home screen user interface 1005 is optionally reached from the unified media browsing application (e.g., when in the unified media browsing application, selecting the "home" button 518 or the "menu button" 516 on the remote control 510, as described with reference to FIG. Figure 5B described). Figure 10R In the present invention, the unified media browsing application has been authorized to act as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device (e.g., as referenced in FIG. Figures 10C to 10L ), and the icon 1018-1 corresponding to the unified media browsing application continues to have the current focus. Since the unified media browsing application is now authorized, the electronic device replaces the display with representations 1022-1 through 1022-4 of media items from Media Providers 1, 2, and 3 in the "top level" area of ​​the user interface 1005 that are accessible from within the unified media browsing application ( Figure 10B Display of user interface element 1020) as described in.

[0258] exist Figure 10S , after the unified media browsing application is authorized to act as a centralized media navigation application, a media application corresponding to media provider 4 is installed on the electronic device, as indicated by the addition of icon 1018-6 in user interface 1005. Therefore, media provider 4 has not yet been authorized to share user-specific information with the unified media browsing application. The electronic device may optionally request such authorization the next time the unified media browsing application or the media application corresponding to media provider 4 is launched. In some embodiments, the electronic device requests such authorization when a media item provided by media provider 4 is selected for playback in the unified media browsing application. For example, Figure 10O In FIG. 6 , a click on the touch-sensitive surface 604 is detected when the icon 1018-1 corresponding to the unified media browsing application has the current focus. In response, the electronic device launches the unified media browsing application, such as Figure 10U As shown. Figure 10U In FIG, a click on the touch-sensitive surface 604 is detected when the representation 1004-20 corresponding to the media item ZZ from the media provider 4 has the current focus. In response, the electronic device prompts the user to authorize the media provider 4 to share user-specific information with the unified media browsing application, such as Figure 10V Specifically, the electronic device displays prompt 1024, button 1026, and button 1027. Prompt 1024 includes a representation of media provider 4, button 1026 is used to authorize media provider 4 to share user-specific information with the unified media browsing application, and button 1027 is used to prevent media provider 4 from sharing user-specific information with the unified media browsing application. Figure 10W In FIG. 5 , when button 1026 has current focus, a click on the touch-sensitive surface 604 is detected, and as a result, the media provider 4 is authorized to share user-specific information with the unified media browsing application. Figure 10W Upon selection of the middle button 1026, and without further user input, the electronic device begins playing the media item ZZ from the media provider 4, as shown in FIG. Figure 10X shown.

[0259] In some embodiments, where the unified media browsing application has not been authorized to act as a centralized media navigation application as described above, the electronic device responds differently to the launch of the unified media browsing application (e.g., as described in reference to FIG. 10A to 10C (described in the preceding text), this depends on whether the media application is currently installed on the electronic device when the unified media browsing application is launched and / or the number of times the unified media browsing application has been launched. For example, when the unified media browsing application is launched for the first time without the media application being installed on the electronic device, the unified media browsing application may optionally display a dialog box including information related to the unified media browsing application, such as Figure 10Y , without showing any specific media applications that a user may install on the electronic device.

[0260] However, when the unified media browsing application is launched a second time (and, optionally, subsequently) without having installed the media applications on the electronic device, the unified media browsing application optionally displays a dialog box that includes representations of specific media applications (e.g., featured media applications, or media applications that are part of a specific media application bundle or package (such as a sports package or a movie package)) that the user can install on the electronic device to begin using the unified media browsing application with those applications, e.g., Figure 10ZProvider 5, Media Provider 6, and Media Provider 7). The user can optionally install the media applications individually (e.g., by selecting the representations of the media applications individually) to initiate authorization of the unified media browsing application with the selected media applications / providers (e.g., similar to the example shown in FIG. 1 ). Figures 10E to 10G ), or install all media applications presented in the dialog box (e.g., by selecting a "Download All" link in the dialog box) to initiate authorization of a unified media browsing application with all displayed media applications / providers (e.g., similar to the one described in reference Figures 10E to 10G As described above). In this way, after the user has previously launched the unified media browsing application at least once, the electronic device only prompts the user to download / install the media application, thereby avoiding unnecessary inconvenience to the user due to presenting such information.

[0261] It should be noted that in some embodiments, when the media application is not installed on the electronic device, the electronic device displays the media application when the unified media browsing application is first launched. Figure 10Z dialog box instead of waiting until the second launch of the unified media browsing application (for example, electronic devices do not display Figure 10Y dialog box).

[0262] In some embodiments, when the unified media browsing application is launched for the first time, but one or more media applications are installed on the electronic device, the electronic device may optionally display a media navigation application. Figure 10C The user interface and the user can initiate Figures 10D to 10G The user is then able to browse various media items in the unified media browsing application, such as the one or more media applications already installed on the electronic device. Figures 10A to 10X In response to subsequently launching the unified media browsing application when the media application is installed on the electronic device, the electronic device optionally displays Figure 10Z A dialog box is displayed to promote or provide additional media applications (e.g., media applications that are not already installed on the electronic device) that the user can download to the electronic device and authorize the unified media browsing application through it.

[0263] Figures 11A to 11F 1 is a flow chart illustrating a method 1100 for facilitating the setup of a unified media browsing application according to some embodiments of the present disclosure. The method 1100 is optionally performed on an electronic device such as device 100, device 300, or device 500 (as described above with reference to FIG. Figure 1A to Figure 1B 、 Figures 2 to 3 as well as Figures 5A to 5B Some operations in method 1100 may be optionally combined, and / or the order of some operations may be optionally changed.

[0264] As described below, method 1100 provides a method for facilitating the setup of a unified media browsing application. This method reduces the cognitive burden on users when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.

[0265] In some embodiments, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) in communication with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510; or a smart phone, such as device 511) receives (1102) via the one or more input devices an input (e.g., selection of a button displayed in a user interface including multiple representations on the display) corresponding to a request to set up a unified media browsing application to browse media corresponding to multiple applications that provide access to media from multiple media providers, such as Figure 10D In some embodiments, the plurality of applications includes a first application and a second application, the first application providing access to first media from a first media provider, and the second application providing access to second media from a second media provider, such as Figure 10E The unified media browsing application optionally acts as a centralized application through which to browse media available via multiple different applications, as described in methods 700 and 900. Before the user authorizes the unified media browsing application to display media available via multiple different applications, the unified media browsing application optionally displays a button, such as Figure 10C After the unified media browsing application is authorized to display media available via multiple different applications, the unified media browsing application optionally stops displaying the button, such as Figure 10G As shown in .

[0266] In response to receiving input corresponding to a request to set up a unified media browsing application to browse media corresponding to multiple applications that provide access to media from multiple media providers, the electronic device initiates (1104) a process of allowing browsing of media accessible via multiple applications on the electronic device in the unified media browsing application, such as Figures 10E to 10F , as shown in (e.g., a process during which a user of an electronic device authorizes a unified media browsing application to display media available via multiple different applications). In some embodiments, the unified media browsing application is different from the multiple applications via which the media is accessible. In some embodiments, initiating the process of allowing browsing of media in the unified media browsing application includes the electronic device simultaneously displaying on a display a representation of a first media provider (1106), a representation of a second media provider (1107) (e.g., a list of different applications on the electronic device via which the media is accessible and from which the unified media browsing application will display media that is browseable by the user in the unified media browsing application), and an optional enable representation (1109), as shown in . Figure 10E In some embodiments, the list of different applications includes images corresponding to those applications (e.g., application icons for those applications) and / or text corresponding to those applications (e.g., names of those applications). In some embodiments, the selectable indication, when selected, provides authorization for multiple media providers to share user-specific information with the unified media browsing application, such as Figure 10F As shown in , the information includes: user-specific information from a first media provider corresponding to a user action (e.g., purchase, rental, favorite / bookmark, watch, etc.) with respect to media available via a first application, and user-specific information from a second media provider corresponding to a user action (e.g., purchase, rental, favorite / bookmark, watch, etc.) with respect to media available via a second application. In this way, the electronic device provides a simple process for authorizing the unified media browsing application and provides information about the media providers as part of the authorization in an easily accessible manner, thereby improving the efficiency of user-electronic device interaction.

[0267] In some embodiments, the plurality of representations of applications correspond to applications associated with a user account of the user on the electronic device, such as applications downloaded on the electronic device logged into the user account, or applications downloaded on other electronic devices that are also associated with (e.g., logged into) the user account (1108). In some embodiments, the plurality of representations of applications correspond to applications downloaded on the electronic device and to which the user is logged into (e.g., the user has provided access credentials to the application such that the application provides access to its corresponding media) (1110).

[0268] Before initiating a process of allowing browsing of media accessible via multiple applications on the electronic device in the unified media browsing application, the unified media browsing application optionally displays (1112) on the display information items related to the unified media browsing application, such as Figure 10C In some embodiments, the unified media browsing application does not display media accessible via multiple applications until a process is initiated to allow the unified media browsing application to provide browseable media, such as Figure 10C After the user selects affordances that provide authorization for multiple media providers to share user-specific information with the unified media browsing application, the unified media browsing application optionally displays (1114) on the display representations of media items accessible from the multiple applications, such as Figure 10G (eg, after the unified media browsing application has been authorized to display browseable media, optionally replacing information items related to the unified media browsing application with browseable media from multiple applications).

[0269] In response to detecting a selection of an affordance providing authorization for a plurality of media providers to share user-specific information with the unified media browsing application, the unified media browsing application optionally displays (1116) trending media items on the display, such as Figure 10G ) (e.g., media items that are not selected for inclusion in the unified media browsing application based on the viewing activity of the user of the electronic device). For example, media that is liked by other viewers or that is otherwise selected by a third party may optionally be included in the trending media items. After detecting a selection of an affordance that provides authorization for multiple media providers to share user-specific information with the unified media browsing application, the electronic device optionally detects (1118) one or more user actions that cause the inclusion of additional media items in the unified media browsing application, such as Figure 10MIn response to detecting one or more user actions, the electronic device optionally replaces (1120) the display of the representation of the trending media item with the representation of the additional media item in the unified media browsing application, as shown in Figure 10N For example, when the user's actions cause more media items to be added to the unified media browsing application, the user's media items replace the trending media items (e.g., when the user's media items replace the trending media items, the trending media items are pushed away from the edge of the screen). In this way, the electronic device switches to displaying media items that the user may be particularly interested in (e.g., because these media items are selected based on the user's actions), which enables the user to easily access these media items and thereby improves the efficiency of the user-electronic device interaction.

[0270] In some embodiments, the input corresponding to the request to set up the unified media browsing application is a selection of a button displayed in the user interface of the unified media browsing application (1122), such as Figure 10D , (e.g., a button is optionally displayed in a user interface in which, upon user permission, representations of media accessible via the plurality of applications are displayed. In some embodiments, the representation of the first media provider and the representation of the second media provider are displayed in a row of representations of the plurality of media providers (1124), as shown in FIG. Figure 10E If greater than a threshold number (e.g., 5, 8, or 10) of media providers are to be added to the unified media browsing application, then in some embodiments, a row of representations of the media providers is animated to scroll through the representations of the media providers.

[0271] In some embodiments, the electronic device receives (1126) input via one or more input devices selecting an optional enable representation that provides authorization for multiple media providers to share user-specific information with the unified media browsing application, such as Figure 10F In response to receiving input selecting the selectable affordance, the electronic device optionally displays (1128) on the display a unified media browsing application including representations of media items accessible from multiple applications, such as Figure 10G(e.g., after the user has authorized media providers to share user-specific information with the unified media browsing application, the unified media browsing application displays representations of media from those applications). The unified media browsing application and its displayed user interface (including representations of media items) are optionally the unified media browsing application and corresponding user interface described in methods 700 and 900. Thus, the electronic device provides a simple process for allowing the unified media browsing application to display representations of media items from multiple media providers, thereby improving the efficiency of user-electronic device interaction.

[0272] After detecting a selection of an affordance providing authorization for multiple media providers to share user-specific information with the unified media browsing application, the electronic device optionally downloads (1130) on the electronic device corresponding applications that provide access to media from the corresponding media providers, such as Figure 10S (e.g., the user downloads the media application to the electronic device after authorizing the media provider to share user-specific information with the unified media browsing application). In some embodiments, after downloading the corresponding application, the electronic device launches (1132) the unified media browsing application or the corresponding application on the electronic device, such as Figure 10U In response to launching the unified media browsing application or the corresponding application on the electronic device (or, in response to detecting input requesting playback of a media item using the corresponding application from within the unified media browsing application), the electronic device optionally displays (1134) an optional affordance on the display, such as Figure 10V When selected, the optional affordance optionally provides authorization for the corresponding media provider to share user-specific information with the unified media browsing application, the user-specific information including user-specific information from the corresponding media provider corresponding to user actions (e.g., purchase, rental, favorite / bookmark, watch, etc.) with respect to media available via the corresponding application, as shown in FIG. Figure 10V In some embodiments, since the corresponding application is downloaded after the user provides the initial authorization to share the user-specific information with the unified media browsing application, the corresponding application may optionally require additional authorization as described above. Therefore, the electronic device provides a simple process for authorizing the media provider corresponding to the newly downloaded application to share the user-specific information with the unified media browsing application, thereby improving the efficiency of the user-electronic device interaction.

[0273] In some embodiments, the electronic device displays (1136) on a display an application browsing user interface (e.g., a home screen of the electronic device including icons of different applications installed on the electronic device, which icons can be selected to launch their corresponding applications on the electronic device), the selectable representations can be selected to open the corresponding applications on the electronic device, and the selectable representations include a selectable representation of a unified media browsing application, which can be selected to open the unified media browsing application on the electronic device, as Figure 10A When the selectable representation of the unified media browsing application has focus, the electronic device optionally displays (1138) one or more user interface elements corresponding to the unified media browsing application in the application browsing user interface, such as Figure 10B and Figure 10R In some embodiments, when the selectable representation of the unified media browsing application loses focus (e.g., the user has moved the focus cursor away from the selectable representation of the unified media browsing application), the electronic device stops displaying the user interface elements corresponding to the unified media browsing application. In some embodiments, the user interface elements corresponding to the unified media browsing application are not displayed until the selectable representation of the unified media browsing application has focus (1140), such as Figure 10A As shown in .

[0274] In some embodiments, prior to initiating a process for allowing browsing of media accessible via multiple applications on the electronic device in the unified media browsing application, the user interface element corresponding to the unified media browsing application is an information item related to the unified media browsing application (1142), such as Figure 10B In some embodiments, the application browsing user interface does not display representations of media accessible via multiple applications until a process is initiated to allow the unified media browsing application to provide browseable media, such as Figure 10B In some embodiments, after the user selects an affordance providing authorization for multiple media providers to share user-specific information with the unified media browsing application, the user interface element corresponding to the unified media browsing application is a representation of media items accessible from the multiple applications (1144), such as Figure 10R(e.g., after the unified media browsing application has been authorized to display browseable media, the information items related to the unified media browsing application are optionally replaced with representations of browseable media from multiple applications). Therefore, through the application browsing user interface of the electronic device, the electronic device provides the user with easily accessible indications of whether the unified media browsing application has been authorized, information items related to the unified media browsing application, and / or media items accessible from the unified media browsing application, thereby improving the efficiency of user-electronic device interaction.

[0275] In some embodiments, the electronic device displays (1146) on the display a setting user interface (e.g., a setting user interface that is a user interface of the operating system of the electronic device but not a user interface of the unified media browsing application), which is used to individually provide authorization for multiple media providers to share corresponding user-specific information with the unified media browsing application, such as Figure 10Q In some embodiments, the setup user interface is a user interface of the unified media browsing application, but in some embodiments, the setup user interface is a user interface of an operating system of the electronic device, but not a user interface of the unified media browsing application. In some embodiments, the setup user interface includes a first switch for authorizing the first media provider to share user-specific information corresponding to a user action with respect to media available via the first application (1148), such as Figure 10Q (e.g., a user can individually allow or disallow a first media provider to share user-specific information with the unified media browsing application so that media from the first application will or will not, respectively, be included in the unified media browsing application.) In some embodiments, the settings user interface includes a second toggle for authorizing a second media provider to share user-specific information from the second media provider corresponding to a user action with respect to media available via the second application (1150), such as Figure 10Q (e.g., the user can individually allow or disallow the second media provider to share user-specific information with the unified media browsing application, so that the media from the second application will or will not be included in the unified media browsing application, respectively). In this way, the electronic device provides a centralized location for managing authorization for sharing user-specific information, thereby improving the efficiency of user-electronic device interaction.

[0276] It should be understood that Figures 11A to 11FThe specific order in which the operations are described in the description is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 700, 900, 1300, and 1900) are also applicable in a similar manner to the details of the processes described above in conjunction with Figures 11A to 11F Method 1100 is described. For example, the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described above with reference to method 1100 may optionally have one or more of the features of the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described herein with reference to other methods described herein (e.g., methods 700, 900, 1300, and 1900). For the sake of brevity, these details are not repeated here.

[0277] The operations in the above information processing method can be optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (for example, as described above in conjunction with Figure 1A 、 Figure 3 、 Figure 5A and Figure 16 In addition, the above reference Figures 11A to 11F The operation is optionally performed by Figure 1A to Figure 1B 1. For example, receiving operation 1102 and initiating operation 1104 are optionally implemented by event classifier 170, event identifier 180, and event handler 190. Event monitor 171 in event classifier 170 detects contact on touch-sensitive surface 604, and event distributor module 174 transmits the event information to application 136-1. The corresponding event identifier 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact at the first position on the touch-sensitive surface corresponds to a predefined event or sub-event, such as the selection of an object on a user interface. When the corresponding predefined event or sub-event is detected, event identifier 180 activates the event handler 190 associated with the detection of the event or sub-event. Event handler 190 optionally utilizes or calls data updater 176 or object updater 177 to update the application internal state 192. In some embodiments, event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know how to Figure 1A to Figure 1B The components depicted in the figure implement other processes.

[0278] User interface for episodic content

[0279] Users interact with electronic devices in many different ways, including interacting with content or media (e.g., music, movies, etc.) that is available (e.g., stored or otherwise accessible) on the electronic device, such as via different content providers and corresponding content applications (e.g., as referenced in the accompanying text). Figures 6A to 6LL 、 Figures 8A to 8GG 、 Figures 10A to 10Z 、 Figures 12A to 12V and / or Figures 18A to 18J As described above). For example, a user can browse and play content accessible on an electronic device. However, the user may wish to view information about a collection of episodic content (e.g., a television series, a mini-series, etc.) from a user interface dedicated to that collection of episodic content. The embodiments described below provide a way for an electronic device to display representations of episodes in a collection of episodic content, thereby enhancing user interaction with the electronic device. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, the person is optionally referred to as a user of the device.

[0280] Figures 12A to 12V The embodiments in these figures are used to illustrate the process described below, including reference to 13A to 13E The process described.

[0281] Figure 12A An exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 12A In the example shown, the display 514 displays a user interface 1202 for a given collection of episodic content (e.g., television programs, mini-series, etc.). The user interface 1202 is optionally a dedicated specification page for a collection of episodic content. In response to a request to a unified media browsing application on an electronic device (e.g., as described in reference to FIG. Figures 6A to 6LL 、 Figures 8A to 8GG and / or Figures 10A to 10Z The user interface 1202 is optionally displayed by selecting a representation of a collection of episodic content displayed in the unified media browsing application. The user interface 1202 is optionally a canonical page that includes information about the television program, for example, including information about the season and / or episode of the television program. Figure 12AIn the example embodiment, user interface 1202 includes a title of an episodic content collection (Content Collection A), a description and type of the episodic content collection, and information about the number of seasons in the episodic content collection. User interface 1202 also includes a “Smart Play” button, selecting which causes the electronic device to play the next episode in the episodic content collection (e.g., the episode after the last episode watched by the user), a “Favorite” button, and a “Buy Season” button. Selecting the “Smart Play” button causes the electronic device to favorite the collection of episodic content (e.g., causing it to be displayed as suggested content in the unified media browsing application), and selecting the “Buy Season” button allows the user to purchase access to one or more seasons of the episodic content collection (if the user does not already have access to those seasons).

[0282] User interface 1202 also includes representations 1204-1 through 1204-4 of episodes from the first season of content set A and representations 1204-5 through 1204-8 of episodes from the second season of content set A. Representations 1204 also include visual indications 1208 of the content providers through which the corresponding episodes are available, but it should be understood that representations 1204 need not include visual indications 1208 (e.g., display of visual indications 1208 is optional). For example, representation 1204-2 corresponding to Season 1, Episode 2 includes indication 1208 indicating that Season 1, Episode 2 is available through Content Provider 1. Some episodes are available through multiple content providers. For example, representation 1204-3 corresponding to Season 1, Episode 3 includes indications that Season 1, Episode 3 is available through Content Providers 1 and 2. In some embodiments, indication 1208 is a textual indication and / or a graphical indication (e.g., a logo of the corresponding content provider). Additionally, some episodes have multiple versions available for viewing on electronic devices (e.g., extended cut, standard cut, director's cut, etc.), while other episodes have a single version available for viewing. For example, Season 1, Episode 1 and Season 2, Episode 1 each have two versions available for viewing (e.g., Versions A and B), while the remaining episodes have a single version available for viewing (e.g., Version A).

[0283] exist Figure 12A, the user of the electronic device has the right to view content from content providers 1, 2, and 3 (e.g., the user has content subscriptions with content providers 1, 2, and 3), as indicated by 1206. It should be understood that in some embodiments, a "user with the right to view the content / media item" refers to an electronic device that is associated with (e.g., logged into) an account that has the right to play the content / media item. The user can obtain each episode in content set A via at least one of content providers 1, 2, and 3. Therefore, the user can access all episodes in content set A, and the electronic device displays representations 1204 with the same visual characteristics (e.g., all representations are displayed as colored (as opposed to grayscale for episodes that the user does not have the right to view), or are displayed without a mark or other indication that a payment or subscription is required to view the episode).

[0284] exist Figure 12B , the user is only entitled to view content from content providers 1 and 3, as indicated by 1206. Therefore, the user is no longer entitled to view Season 2, Episode 3 and Season 2, Episode 4. Therefore, the electronic device displays representations 1204-7 and 1204-8 corresponding to Season 2, Episode 3 and Season 2, Episode 4, respectively, with representations 1204-7 and 1204-8 having different visual characteristics than representations 1204-1 through 1204-6 corresponding to the episodes that the user is entitled to view. For example, the electronic device displays a "Purchase" indicia in representations 1204-7 and 1204-8 to indicate to the user that the user is not entitled to view Season 2, Episode 3 and Season 2, Episode 4 and must purchase access to those episodes (or otherwise subscribe to the content providers).

[0285] Furthermore, in some embodiments, the ordering of indications 1208 in representation 1204 is based on the user's rights to view corresponding episodes on various content providers. For example, visual indications of content providers on which the user has rights to view the episodes are displayed first, followed by visual indications of preferred content providers (if any) that the user is required to purchase or otherwise pay to access the episodes (e.g., a third party has designated as a preferred content provider), and then visual indications of content providers on which the user does not have rights to view the episodes are displayed. For example, in Figure 12B , indication 1208 in representation 1204-5 includes an indication for content provider 3 displayed first, an indication for content provider 2 displayed second, and an indication for content provider 4 listed last because the user has rights to access content via content provider 3 and does not have rights to access content via content providers 2 or 4. Content provider 2 is optionally a preferred content provider, and content provider 4 is optionally not a preferred content provider; therefore, content provider 2 is optionally displayed before content provider 4.

[0286] In some embodiments, representation 1204 may be selected to play its corresponding episode on an electronic device. Figure 12C In FIG, a click on the touch-sensitive surface 604 is detected while representation 1204-2 corresponding to Season 1, Episode 2 has current focus. Since Season 1, Episode 2 is only available via Content Provider 1 and has only a single available version (Version A), in response to selection of representation 1204-2, the electronic device plays Version A of Season 1, Episode 2 in the media application corresponding to Content Provider 1, as shown in FIG. Figure 12D As shown in .

[0287] exist Figure 12E , a tap on the touch-sensitive surface 604 is detected while representation 1204-1 corresponding to Season 1, Episode 1 has current focus. However, compared to Season 1, Episode 2, two versions of Season 1, Episode 1 are available for viewing (both via Content Provider 1). Because multiple versions of Season 1, Episode 1 are available for viewing, in response to selection of representation 1204-1, the electronic device displays representation 1210-1 of Version A of Season 1, Episode 1, and representation 1210-2 of Version B of Season 1, Episode 1, as shown in FIG. Figure 12F . Both representations 1210-1 and 1210-2 can be selected to play the corresponding version of Season 1, Episode 1 on the electronic device. In addition, representations 1210-1 and 1210-2 include various information about the versions of Season 1, Episode 1, including version information (e.g., extended cut, director's cut, etc.), images corresponding to the different versions, and information about the content providers through which the various versions are available. Figure 12F , representation 1210 - 1 corresponding to version A of Season 1, Episode 1 has current focus.

[0288] exist Figure 12G , a left-to-right swipe contact 608 is detected on touch-sensitive surface 604, which causes representation 1210-2 corresponding to Version B of Season 1, Episode 1 to have current focus. Figure 12H In FIG, when representation 1210-2 has current focus, a click on touch-sensitive surface 604 is detected. In response, the electronic device plays Season 1, Episode 1 of Version B in the media application corresponding to Content Provider 1, as shown in FIG. Figure 12I As shown in .

[0289] In some embodiments, if a representation of an episode is selected that has multiple versions available and / or is available via multiple content providers, the electronic device displays an optional representation of each version and / or an optional representation corresponding to each content provider, even if the user of the electronic device does not have permission to view the versions and / or access the content on the content providers. Figure 12J, a click on the touch-sensitive surface 604 is detected while representation 1204-5 corresponding to Season 2, Episode 1 has current focus. Figure 12J As shown, Season 2, Episode 1 has two versions available for viewing (eg, Version A and B) and is available via multiple content providers (eg, Content Providers 2, 3, and 4).

[0290] In response to selection of representation 1204-5, the electronic device displays representations 1210-3 to 1210-5 corresponding to different content providers / versions associated with Season 2, Episode 1. Specifically, the electronic device displays representation 1210-3 corresponding to Version A of Season 2, Episode 1, which is available via Content Provider 3 (the user of the electronic device has the right to access content via this content provider). The electronic device also displays representation 1210-4 corresponding to Version B of Season 2, Episode 1, which is available via Content Provider 2 (the user of the electronic device has the right to access content via this content provider). Finally, the electronic device additionally displays representation 1210-5 corresponding to Version A of Season 2, Episode 1, which is available via Content Provider 4 (the user of the electronic device does not have the right to access content via this content provider). Therefore, even if the user of the electronic device does not have the right to access their corresponding episodes, the electronic device displays representations 1210-4 and 1210-5. However, to indicate that the user has access to certain versions / content providers but not others, the electronic device displays representation 1210-3 (corresponding to authorized content) having different visual characteristics than representations 1210-4 and 1210-5 (not corresponding to authorized content) (e.g., colored versus grayscale, without a "need to purchase" indicia versus with a "need to purchase" indicia, etc.). Representation 1210-3 may be selected to play Season 2, Episode 1 of Version A via Content Provider 3 (e.g., as shown in FIG. 1 ). FIG. 12H to FIG. 12I ). Representations 1210-4 and 1210-5 may optionally be selected to purchase and then watch their corresponding episodes, respectively, and / or to subscribe to content providers 2 and 4, respectively, and then watch their corresponding episodes.

[0291] For example, in Figure 12L , a left-to-right swipe contact 608 is detected on the touch-sensitive surface 604, and in response, representation 1210-4 corresponding to Version B of Season 2, Episode 1 from Content Provider 2 gains current focus. Figure 12M In FIG, when representation 1210-4 has current focus, a click on touch-sensitive surface 604 is detected. In response, Figure 12N, the electronic device displays a page through which the user can: purchase Season 2, Episode 1 of Version B (e.g., by selecting button 1250) to view the episode; subscribe to Content Provider 2 to view the episode (e.g., by selecting button 1252); or cancel the request to view the episode (e.g., by selecting button 1254, which optionally returns the electronic device to the Figure 12L (display).

[0292] exist Figure 12N In FIG, a click on touch-sensitive surface 604 is detected when button 1250 has current focus. In response, the user has now purchased access to version B of Season 2, Episode 1 from content provider 2. In some embodiments, if the content application for viewing version B of Season 2, Episode 1 via content provider 2 is not installed on the electronic device, then in response to the click, the user can access the content provider 2 by clicking on touch-sensitive surface 604. Figure 12N When the button 1250 is selected, the electronic device displays ( Figure 12O ) via which the user can install the content application (e.g., by selecting button 1256) or not install the application (e.g., by selecting button 1258, which optionally returns the electronic device to Figure 12L The page of the display). Figure 12O In FIG, when button 1256 has current focus, a click on touch-sensitive surface 604 is detected. In response, without further user input, the electronic device downloads and / or installs the content application for content provider 2 and begins playing Season 2, Episode 1 of Version B in the content application, as shown in FIG. Figure 12P In some embodiments, if the content application for content provider 2 is already installed on the electronic device, Figure 12N Selection of button 1250 in causes the electronic device to immediately (e.g., without further user input) play Season 2, Episode 1 of Version B in the content application, as shown in FIG. Figure 12P Shown, not shown Figure 12O page.

[0293] In some cases, a user may subscribe to content provider 2 to watch season 2, episode 1 of version B. For example, Figure 12Q In FIG, a click on the touch-sensitive surface 604 is detected when the button 1252 for subscribing to the content provider 2 has the current focus. In response, the electronic device displays (in Figure 12R ) a page via which the user can confirm a subscription request to the content provider 2 (e.g., by selecting button 1260) or cancel a subscription request (e.g., by selecting button 1262, which optionally returns the electronic device to Figure 12Q ). Figure 12RIn the example embodiment, a click on the touch-sensitive surface 604 is detected when the button 1260 for confirming the subscription to content provider 2 has the current focus. In some embodiments, if the content application for watching Season 2, Episode 1 of Version B via content provider 2 is not installed on the electronic device, in response to the click on the touch-sensitive surface 604, the content application is not installed on the electronic device. Figure 12R By selecting button 1260 in the content provider 2, the electronic device allows the user to subscribe to the content provider 2 and display (in Figure 12S ) via which the user can install the content application (e.g., by selecting button 1256) or not install the application (e.g., by selecting button 1258, which optionally returns the electronic device to Figure 12Q The page of the display). Figure 12S In FIG, when button 1256 has current focus, a click on touch-sensitive surface 604 is detected. In response, the electronic device downloads and / or installs a content application for content provider 2 and, without further user input, begins playing Season 2, Episode 1 of Version B in the content application, as shown in FIG. Figure 12T In some embodiments, if the content application for content provider 2 is already installed on the electronic device, Figure 12R Selection of button 1260 in causes the electronic device to subscribe the user to content provider 2 and immediately (e.g., without further user input) play Season 2, Episode 1 of Version B in the content application, as shown in FIG. Figure 12T Shown, not shown Figure 12S page.

[0294] In some embodiments, when the content application for content provider 2 is not installed on the electronic device, the subscription to content provider 2 and the installation of the corresponding content application are simplified to respond to a single input. Figure 12Q Selection of button 1252 in (eg, for subscribing to content provider 2) causes the electronic device to display (in Figure 12U ) a page through which the user can: confirm the subscription request to the content provider 2 (e.g., by selecting button 1260, as shown in reference Figure 12R ); confirming the subscription request to content provider 2 and installing the content application for content provider 2 (e.g., by selecting button 1264); or canceling the subscription request (e.g., by selecting button 1262, which optionally returns the electronic device to Figure 12Q ). Figure 12UIn FIG, when button 1264 has the current focus, a click on the touch-sensitive surface 604 is detected. In response, without further user input, the electronic device allows the user to subscribe to, download and / or install a content application for content provider 2 from content provider 2, and begins playing Season 2, Episode 1 of Version B in the content application, as shown in FIG. Figure 12V As shown in .

[0295] 13A to 13E 1 is a flow chart illustrating a method for displaying a representation of an episode in an episode content collection according to some embodiments of the present disclosure. Method 1300 is optionally performed on an electronic device such as device 100, device 300, or device 500 (as described above with reference to FIG. Figure 1A to Figure 1B 、 Figures 2 to 3 as well as Figures 5A to 5B Some operations in method 1300 may be optionally combined, and / or the order of some operations may be optionally changed.

[0296] As described below, method 1300 provides a way to display a representation of an episode within a collection of episode content. This method reduces the cognitive burden on a user when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface conserves power and increases the time between battery charges.

[0297] In some embodiments, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) in communication with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510; or a smartphone, such as device 511) displays (1302) on the display a user interface for a corresponding collection of episodic content (e.g., a television program, a mini-series, etc.). Figure 12A The user interface may optionally be a dedicated specification page for a collection of episodic content. For example, a specification page may include information about a television program, such as seasons and / or episodes of a television program. In some embodiments, the user interface may include multiple representations of episodes of a corresponding collection of episodic content, such as Figure 12A , as shown in (e.g., the user interface includes a block or other representation for each of a plurality of episodes of episodic content). Each representation optionally includes an image and / or video from the corresponding episode, and / or textual information about the corresponding episode. A representation is optionally selectable to view or purchase an episode from the collection of episodic content. In some embodiments, the plurality of representations of the episodes include one or more visual indications of one or more corresponding content providers from which the corresponding episodes of the corresponding collection of episodic content are available (1304), such as Figure 12AIn some embodiments, different episodes of a television program may be available via different content providers. For example, some episodes may be available via a first content provider, while other episodes may be available via a second content provider, and some episodes may be available via both. Representations of episodes may optionally include a visual indication of the content provider from which the episode is available. For example, a first representation may include an icon / graphic / text indicating the first content provider, and a second representation may include an icon / graphic / text indicating the second content provider.

[0298] Based on determining that the user of the electronic device does not have rights to view all episodes in the corresponding collection of episodic content on the electronic device (1306) (e.g., the user of the electronic device may have subscriptions to some content providers but not others), the electronic device optionally displays (1308) a first set of one or more representations of the plurality of representations of episodes that the user has rights to view on the electronic device, having the first visual characteristic, such as Figure 12B If the user does not have a subscription to any content provider through which episodes of the television series are available, the user optionally does not have permission to view the episodes on the electronic device. Based on determining that the user of the electronic device does not have permission to view all episodes in the corresponding collection of episodic content on the electronic device (1306), the electronic device optionally displays (1310) a second set of one or more representations of the plurality of representations of the episodes that the user does not have permission to view on the electronic device having a second visual characteristic, the second visual characteristic being different from the first visual characteristic, such as Figure 12B ) as shown in (e.g., a tag overlay is optionally displayed on a representation of an episode that the user does not have the right to watch on the electronic device). The tag overlay optionally indicates that the user can purchase the episode or subscribe to a service to obtain access to the episode. In some embodiments, additional or alternative visual feature differences are utilized to display authorized episodes that are different from unauthorized episodes. Therefore, in some embodiments, the user interface displays all episodes in a collection of plot content that can be accessed from the electronic device, regardless of whether the user has the right to watch those episodes. It should be understood that in some embodiments, a "user who has the right to watch the media item" refers to an electronic device that is associated with an account that has the right to play the content (e.g., logged into the account). In this way, the electronic device displays information about a collection of episode content that allows the user to easily determine which episodes the user has the right to watch, thereby improving the efficiency of user-electronic device interaction.

[0299] In some embodiments, the plurality of representations of the episode includes respective representations of the respective episode available on a plurality of content providers (e.g., the episode is available on a first content provider and a second content provider, etc.), the respective representations including a plurality of visual indicators corresponding to the plurality of content providers (1312), such as Figure 12BIn some embodiments, a plurality of visual indications corresponding to a plurality of content providers are displayed in the respective representations in an order based on the user's rights to view the respective episodes on the plurality of content providers (1314), such as Figure 12B (e.g., first displaying visual indications of content providers on which the user has the right to view the corresponding episode; then displaying one or more visual indications of preferred content providers that require the user to purchase or otherwise pay to access the episode; and then displaying visual indications of content providers on which the user does not have the right to view the episode.) In this way, the electronic device displays information about episodes in the episode content collection that allows the user to easily determine which content provider will provide a given episode, thereby improving the efficiency of user-electronic device interaction.

[0300] Based on determining that the user of the electronic device has the right to view all episodes in the corresponding collection of episodic content on the electronic device, the electronic device optionally displays (1316) all representations of the plurality of representations of the episodes that the user has the right to view on the electronic device that have the same visual characteristics, such as Figure 12A In this way, the electronic device displays information about episodes in the episode content collection that allows the user to easily determine which episodes the user is entitled to view, thereby improving the efficiency of user-electronic device interaction.

[0301] While displaying the plurality of representations of the episodes in the corresponding collection of episodic content, the electronic device optionally receives (1318) input via one or more input devices corresponding to a request to watch a corresponding episode in the corresponding collection of episodic content, such as Figure 12E and Figure 12J In response to receiving the input (1320), based on determining that multiple versions of the corresponding episode (e.g., an extended cut, a standard cut, etc.) are available or the corresponding episode is available from multiple content providers (e.g., available from HBO, Netflix, Showtime, etc.), the electronic device optionally displays (1322) on the display the corresponding episode corresponding to the multiple versions of the corresponding episode or the multiple representations of the corresponding episode from the multiple content providers on which the corresponding episode is available, as shown in FIG. Figure 12F and Figure 12K In some embodiments, a first representation of a plurality of representations of a corresponding episode may be selected to initiate viewing of a first version of the corresponding episode, and a second representation of a plurality of representations of a corresponding episode may be selected to initiate viewing of a second version of the corresponding episode, as shown in FIG. Figure 12F and Figure 12K (e.g., if the episode has multiple versions or is accessible from multiple providers, a collection of representations corresponding to the different versions / providers are displayed, each of which can be selected to initiate the process of viewing the episode (a specific version of the episode and / or an episode from a specific content provider). In response to receiving the input (1320), based on determining that a single version of the corresponding episode is available and the corresponding episode is available from a single content provider, the electronic device optionally plays (1324) the single version of the episode on the display via the single content provider, as shown in FIG. Figure 12D (For example, if the episode does not have multiple versions and is not accessible from multiple providers, clicking on the representation of the episode causes the electronic device to play the episode.) In this way, the electronic device displays information about the episodes in the episode content collection, which allows the user to easily determine which episodes the user is authorized to view, thereby improving the efficiency of the user-electronic device interaction. ...

Claims

1. A method comprising: At an electronic device in communication with a display and one or more input devices: receiving, via the one or more input devices, a request to display suggested media items on the display; In response to receiving a request to display suggested media items on the display, displaying a plurality of representations of suggested media items available via the electronic device via different media sources in a media suggestion user interface on the display, comprising: based on determining that a media item corresponding to a first live event media item for a first event that satisfies first selection criteria of a user of the device is viewable via the electronic device, simultaneously displaying in the media suggestion user interface on the display a representation of the first live event media item and a corresponding representation of an on-demand media item suggested for the user based on second selection criteria; as well as Based on determining that media items corresponding to live event media items of an event that meets the first selection criteria of a user of the device are not available for viewing via the electronic device, representations of multiple on-demand media items recommended for the user based on the second selection criteria are simultaneously displayed in the media suggestion user interface on the display, without displaying representations of the live event media items on the display.

Citation Information

Patent Citations

  • Method and apparatus for integrating manual input

    US20020015024A1

  • Acceleration-based theft detection system for portable electronic devices

    US20050190059A1

  • Methods and apparatuses for operating a portable device based on an accelerometer

    US20060017692A1

  • Gestures for touch sensitive input devices

    US20060026521A1

  • Gestures for touch sensitive input devices

    US20060026536A1