A user interface for browsing content from multiple content applications on electronic devices.

An integrated media browsing application on electronic devices addresses inefficiencies in user interaction by unifying media access, enhancing user experience and reducing interaction time, particularly in battery-powered devices.

JP7891579B2Active Publication Date: 2026-07-16APPLE INC

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
APPLE INC
Filing Date
2025-08-18
Publication Date
2026-07-16

AI Technical Summary

Technical Problem

Existing electronic devices struggle with inefficient user interaction and content browsing across multiple media applications, particularly in battery-powered devices, which affects user experience and critical interaction time.

Method used

Implementing an integrated media browsing application that presents media items from different media applications within a unified interface, facilitating browsing by category, setting up an integrated media browsing application, and displaying live event media items, enhancing user interaction and reducing interaction time.

Benefits of technology

The integrated media browsing application improves user experience by streamlining content access across multiple applications, reducing interaction time, and optimizing battery usage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007891579000002
    Figure 0007891579000002
  • Figure 0007891579000003
    Figure 0007891579000003
  • Figure 0007891579000004
    Figure 0007891579000004
Patent Text Reader

Abstract

To present suggested media items to improve interactions between a user and an electronic device.SOLUTION: At an electronic device in communication with a display and one or more input devices, a method comprises displaying, in a user interface on the display, a plurality of representations of suggested media items. These representations are displayed overlaid on top of first representative content that corresponds to a first media item of the suggested media items that currently has focus. The method also comprises: during the display, receiving, via the one or more input devices, a request to navigate through the plurality of representations of the suggested media items; in response to the reception, transitioning a second media item of the suggested media items to having focus instead of the first media item having focus; and replacing the display of the first representative content with second representative content that corresponds to the second media item.SELECTED DRAWING: Figure 7A
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims priority based in its entirety on U.S. Provisional Patent Application No. 62 / 413,333, filed Oct. 26, 2016; U.S. Provisional Patent Application No. 62 / 423,150, filed Nov. 16, 2016; U.S. Provisional Patent Application No. 62 / 556,912, filed Sep. 11, 2017; and U.S. Provisional Patent Application No. 15 / 719,404, filed Sep. 28, 2017, each of which is hereby incorporated by reference in its entirety.

[0002] [Technical Field] This application generally relates to electronic devices that enable browsing and playback of content, as well as user interaction with such devices.

Background Art

[0003] User interaction with electronic devices has increased significantly in recent years. These devices can be devices such as computers, tablet computers, televisions, multimedia devices, mobile devices, etc.

[0004] Such devices may access content or media (such as music, movies, TV shows, etc.) via content applications installed on the device that are associated with a content provider, and user interaction with such devices requires browsing and playing content using the content applications. Improving these interactions enhances the quality of the user experience using the device and, in particular when the input device is battery - powered, reduces the critical user interaction time.

Summary of the Invention

[0005] Some embodiments described in this disclosure relate to one or more electronic devices that present media items from different media applications within an integrated media browsing application, and one or more operations that these electronic devices optionally perform. Some embodiments described in this disclosure relate to one or more electronic devices that facilitate browsing media from different media applications based on media categories (such as movies, television programs, etc.), and one or more operations that these electronic devices optionally perform. Some embodiments described in this disclosure relate to one or more electronic devices that facilitate setting up an integrated media browsing application that presents media items from different media applications within an integrated media browsing user interface, and one or more operations that these electronic devices optionally perform. Some embodiments described in this disclosure relate to one or more electronic devices that present multiple episodes of a collection of episodic content (such as a television series) within a user interface for the collection of episodic content, and one or more operations that these electronic devices optionally perform. Some embodiments described in this disclosure relate to one or more electronic devices that display and provide access to representations of live event media items accessible on an electronic device, and one or more operations relating to the above that these electronic devices optionally perform. These embodiments are fully described in the drawings and the detailed description of the invention, and it is understood that the above summary does not limit the scope of this disclosure in any way. [Brief explanation of the drawing]

[0006] These various embodiments will be better understood by referring to the following detailed description in conjunction with the attached drawings. In the drawings, similar reference symbols across different drawings refer to corresponding elements.

[0007] [Figure 1A] This is a block diagram illustrating a multifunctional device having a touch-sensitive display, based on some embodiments of the present disclosure.

[0008] [Figure 1B] This is a block diagram illustrating exemplary components for event processing based on some embodiments of the present disclosure.

[0009] [Figure 2] This figure illustrates a multifunctional device having a touchscreen, based on several embodiments of the present disclosure.

[0010] [Figure 3] This is a block diagram illustrating a multifunctional device having a display and a touch-sensitive surface, based on some embodiments of the present disclosure.

[0011] [Figure 4] This figure illustrates an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display, based on some embodiments of the present disclosure.

[0012] [Figure 5A] This is a block diagram of an exemplary configuration of a device based on some embodiments of the present disclosure. [Figure 5B] This is a block diagram of an exemplary configuration of a device based on some embodiments of the present disclosure.

[0013] [Figure 6A] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6B]This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6C] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6D] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6E] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6F] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6G] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6H] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6I] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6J]An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6K] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6L] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6M] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6N] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6O] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6P] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6Q] An exemplary method is illustrated in which an electronic device presents recommended media items (such as movies, TV shows, etc.) to a user within an integrated media browsing application, based on some embodiments of the present disclosure. [Figure 6R]This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6S] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6T] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6U] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6V] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6W] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6X] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6Y] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6Z]This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6AA] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6BB] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6CC] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6DD] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6EE] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6FF] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6GG] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6HH]This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6II] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6JJ] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6KK] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 6LL] This illustrates exemplary ways in which an electronic device presents a user with recommended media items (such as movies and TV shows) within an integrated media browsing application, based on several embodiments of the present disclosure.

[0014] [Figure 7A] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7B] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7C] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7D]This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7E] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7F] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7G] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7H] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7I] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7J] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7K] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure. [Figure 7L] This flowchart illustrates how to present recommended media items (such as movies and TV shows) to a user within an integrated media browsing application, based on several embodiments of this disclosure.

[0015] [Figure 8A] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8B] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8C] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8D] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8E] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8F] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8G] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8H] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8I] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8J] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8K] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8L] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8M] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8N] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8O] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8P] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8Q] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8R] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8S] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8T] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8U]This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8V] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8W] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8X] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8Y] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8Z] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8AA] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8BB] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8CC] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8DD] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8EE]This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8FF] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure. [Figure 8GG] This illustrates exemplary ways in which an electronic device facilitates browsing of media items by category, based on several embodiments of the present disclosure.

[0016] [Figure 9A] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9B] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9C] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9D] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9E] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9F] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9G] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9H] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure. [Figure 9I] This flowchart illustrates a method for facilitating browsing of media items by category, based on several embodiments of the present disclosure.

[0017] [Figure 10A] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10B] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10C] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10D] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10E] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10F] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10G] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10H] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10I]This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10J] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10K] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10L] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10M] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10N] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10O] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10P] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10Q] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10R] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10S] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10T] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10U] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10V] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10W] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10X] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10Y] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure. [Figure 10Z] This diagram illustrates exemplary ways in which an electronic device facilitates the setup of an integrated media browsing application, based on several embodiments of the present disclosure.

[0018] [Figure 11A] This flowchart illustrates a method for facilitating the setup of an integrated media browsing application based on several embodiments of the present disclosure. [Figure 11B]This flowchart illustrates a method for facilitating the setup of an integrated media browsing application based on several embodiments of the present disclosure. [Figure 11C] This flowchart illustrates a method for facilitating the setup of an integrated media browsing application based on several embodiments of the present disclosure. [Figure 11D] This flowchart illustrates a method for facilitating the setup of an integrated media browsing application based on several embodiments of the present disclosure. [Figure 11E] This flowchart illustrates a method for facilitating the setup of an integrated media browsing application based on several embodiments of the present disclosure. [Figure 11F] This flowchart illustrates a method for facilitating the setup of an integrated media browsing application based on several embodiments of the present disclosure.

[0019] [Figure 12A] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12B] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12C] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12D] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12E] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12F]This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12G] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12H] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12I] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12J] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12K] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12L] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12M] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12N] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12O] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12P] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12Q] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12R] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12S] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12T] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12U] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content. [Figure 12V] This illustrates an exemplary method, based on several embodiments of the present disclosure, in which an electronic device displays a representation of an episode within a collection of episodic content.

[0020] [Figure 13A] This flowchart illustrates a method for displaying a representation of an episode within a collection of episodic content, based on several embodiments of the present disclosure. [Figure 13B] This flowchart illustrates a method for displaying a representation of an episode within a collection of episodic content, based on several embodiments of the present disclosure. [Figure 13C] This flowchart illustrates a method for displaying a representation of an episode within a collection of episodic content, based on several embodiments of the present disclosure. [Figure 13D] This flowchart illustrates a method for displaying a representation of an episode within a collection of episodic content, based on several embodiments of the present disclosure. [Figure 13E] This flowchart illustrates a method for displaying a representation of an episode within a collection of episodic content, based on several embodiments of the present disclosure.

[0021] [Figure 14] This is a functional block diagram of an electronic device based on some embodiments of the present disclosure. [Figure 15] This is a functional block diagram of an electronic device based on some embodiments of the present disclosure. [Figure 16] This is a functional block diagram of an electronic device based on some embodiments of the present disclosure. [Figure 17] This is a functional block diagram of an electronic device based on some embodiments of the present disclosure.

[0022] [Figure 18A] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18B] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18C] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18D] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18E] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18F] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18G] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18H] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18I] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device. [Figure 18J] This document illustrates exemplary ways in which an electronic device, based on several embodiments of the present disclosure, displays and provides access to representations of live event media items accessible on the electronic device.

[0023] [Figure 19A] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19B] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19C]This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19D] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19E] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19F] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19G] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19H] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19I] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19J] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Figure 19K] This flowchart illustrates a method for displaying and providing access to representations of live event media items accessible on an electronic device, based on several embodiments of the present disclosure. [Modes for carrying out the invention]

[0024] In the detailed description of the embodiments below, reference is made to the accompanying drawings illustrating specific embodiments that form part of this disclosure and are optionally implemented. It should be understood that other embodiments may be optionally used and configuration changes may be optionally made without departing from the scope of the disclosed embodiments. Furthermore, in the following description, terms such as “first,” “second,” etc., are used to describe various elements, but these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, without departing from the scope of the various embodiments described, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch. Both the first touch and the second touch are touches, but they are not identical touches.

[0025] The terms used in the descriptions of the various embodiments described herein are intended solely to describe specific embodiments and are not intended to limit them. The singular forms “a,” “an,” and “the” used in the descriptions of the various embodiments and the appended claims should be understood to include the plural forms unless otherwise expressly stated. The terms “and / or” as used herein should be understood to refer to and include any and all possible combinations of one or more of the related enumerated terms. Furthermore, the terms “including,” “having,” “equipped,” and / or “equipped,” as used herein, describe the presence of described features, completes, processes, operations, elements, and / or parts, but should not be understood to exclude the presence or addition of one or more other features, completes, processes, operations, elements, parts, and / or groups thereof.

[0026] The phrase "if" is optionally intended to mean, depending on the context, "when," "then," "in response to the determination that," or "in response to the detection of." Similarly, the phrases "if it is determined that" or "if (the described state or event) is detected" are optionally intended to mean, depending on the context, "when it is determined that," "in response to the determination that," "when (the described state or event) is detected," or "in response to the detection of (the described state or event)."

[0027] [Example device] This document describes embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices. In some embodiments, the device is a portable communication device, such as a mobile phone, which also has other functions, such as a PDA and / or music player functionality. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices sold by Apple Inc. in Cupertino, California. Other portable electronic devices, such as laptop or tablet computers having touch-sensitive surfaces (such as touchscreen displays and / or touchpads), are optionally used. In some embodiments, it should be understood that the device is not a portable communication device, but a desktop computer or television having touch-sensitive surfaces (such as touchscreen displays and / or touchpads). In some embodiments, the device does not have a touchscreen display and / or touchpad, but is capable of outputting display information (such as the user interfaces of this disclosure) for display on a separate display device, and is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, touchscreen displays and / or touchpads). In some embodiments, the device has a display but is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, a touchscreen display and / or a touchpad).

[0028] Electronic devices having a display and a touch-sensitive surface are described below. However, it should be understood that an electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick. Furthermore, as stated above, it should be understood that the described electronic devices, displays, and touch-sensitive surfaces may optionally be distributed between two or more devices. Accordingly, as used in this disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device for display on a separate display device (which may be touch-sensitive or not). Similarly, as used in this disclosure, input received on an electronic device (such as touch input received on the touch-sensitive surface of an electronic device) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0029] The device typically supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video playback device applications.

[0030] Various applications running on a device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or modified on an application-by-application basis and / or within each application. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports these various applications using an intuitive and transparent user interface for the user.

[0031] In several embodiments of portable or nonportable devices having a touch-sensitive display, it should be noted that these devices do not necessarily have a touch-sensitive display or a general display, as described above. Figure 1A is a block diagram illustrating a portable or nonportable multifunctional device 100 having a touch-sensitive display 112, based on several embodiments of the present disclosure. The touch-sensitive display 112 may be referred to as a “touchscreen” for convenience, and may also be known or referred to as a touch-sensitive display system. Device 100 has a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally has one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact with Device 100 (such as a touch-sensitive surface like the touch-sensitive display system 112 of Device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on Device 100 (for example, generating tactile output on a touch-sensitive surface such as the touch-sensitive display system 112 of Device 100 or the touchpad 355 of Device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0032] As used herein and in the claims, the term “intensity” of contact with a touch-sensitive surface refers to the force or pressure (force per unit area) of contact (such as finger contact) with the touch-sensitive surface, or a substitute for the force or pressure of contact with the touch-sensitive surface. The intensity of contact has a range of values ​​including at least four distinct values, more typically several hundred distinct values ​​(such as 256). The intensity of contact is determined (or measured) arbitrarily using various methods and various sensors or combinations of sensors. For example, one or more force sensors directly below or adjacent to the touch-sensitive surface are optionally used to measure forces at various points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of a stylus on the touch-sensitive surface. Alternatively, as a substitute for the force or pressure of contact with the touch-sensitive surface, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance of the touch-sensitive surface adjacent to the contact and / or the resistance of the touch-sensitive surface adjacent to the contact may be optionally used. In some embodiments, a substitute measurement of contact force or pressure is used to directly determine whether it exceeds an intensity threshold (expressed, for example, in units corresponding to the substitute measurement). In some embodiments, a substitute measurement of contact force or pressure is converted to an estimated force or pressure, which is used to directly determine whether it exceeds an intensity threshold (for example, a pressure threshold measured in pressure units). On small devices where there is limited space for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical control unit such as a knob or button), using the intensity of contact as an attribute of user input allows the user to access further functions of the device that they might otherwise not be able to access.

[0033] As used herein and in the claims, the term “tactile output” refers to the physical displacement of the device relative to its previous position, the physical displacement of a component of the device relative to another component of the device (such as a touch-sensitive surface), or the displacement of a component relative to the center of mass of the device, as detected by the user using the user’s sense of touch. For example, when the device or a component of the device is in contact with the surface of a user who is responsible for touch (such as a finger, palm, or other part of the user’s hand), the tactile output generated by the physical displacement is interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or a component of the device. For example, the movement of a touch-sensitive surface (such as a touch-sensitive display or trackpad) is optionally interpreted by the user as a “down click” or “up click” of a physical actuator button. In some cases, the user may feel a tactile sensation such as a “down click” or “up click” even if there is no movement of a physical actuator button associated with a touch-sensitive surface that is physically pressed (such as being displaced) by the user’s movement. As another example, even if the smoothness of the touch-sensitive surface does not change, the movement of the touch-sensitive surface may be optionally interpreted or perceived by the user as "undulation" of the touch-sensitive surface. While such interpretations of touch by the user are subject to the user's personal perception, there are many touch sensations that are common to the majority of users. Therefore, when a tactile output is described as corresponding to a specific user sensation (such as "up click," "down click," or "undulation"), unless otherwise specified, the generated tactile output corresponds to a physical displacement of the device or its components that produces the aforementioned sensation for a typical (or average) user.

[0034] It should be understood that device 100 is merely an example of a portable or non-portable multifunction device, and that device 100 may optionally have more or fewer components than those shown, be a combination of two or more components, or optionally have a different configuration or arrangement of components. The various components shown in Figure 1A are implemented as hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application-specific integrated circuits. Furthermore, the various components shown in Figure 1A may optionally be implemented across two or more devices, such as display and audio circuits on a display device, a touch-sensitive surface on an input device, and other components on device 100. In such embodiments, device 100 optionally communicates with a display and / or input device described in this disclosure to facilitate the operation of the system, and the various display and / or input-related components described in this disclosure are present in device 100 or optionally included in the display and / or input device as needed.

[0035] Memory 102 optionally includes high-speed random-access memory and optionally includes one or more non-volatile memories such as magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0036] A peripheral device interface 118 may be used to connect the device's input and output peripherals to the CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data.

[0037] In some embodiments, the peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0038] The RF (radio frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. The RF circuit 108 converts electrical signals to electromagnetic signals and electromagnetic signals to electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes known circuits for performing these functions, which do not necessarily include an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a receiver identification information module (SIM) card, memory, etc. The RF circuit 108 optionally communicates wirelessly with the Internet, also known as the World Wide Web (WWW), intranets and / or wireless networks such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and other devices. The RF circuit 108 optionally includes known circuits for detecting near-field communication (NFC) fields by near-field communication radio or the like. Wireless communication includes Global System for Mobile Communications (GSM), Extended Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution Data Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPADA), Long-Term Evolution (LTE), Near Field Communication (NFC), and Wideband Code Division Multiple Access (W-CDMA). The present invention may optionally use any of several communication standards, protocols, and technologies, including, but not limited to, suitable communication protocols, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, Email Protocol (IMAP) (e.g., Internet Message Access Protocol and / or Post Office Protocol (POP)), Instant Messaging, Session Initiation Protocol for Instant Messaging and Presence Event Package (SIMPLE), Instant Messaging and Presence Service (IMPS)) (e.g., Extensible Messaging and Presence Protocol (XMPP)), and / or Short Message Service (SMS), or any other communication protocols not yet developed at the time of filing of this document.

[0039] The audio circuit 110, speaker 111, and microphone 113 constitute an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into sound waves that can be heard by a person. The audio circuit 110 also receives the electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 further includes a headset jack (e.g., 212 in Figure 2). The headset jack forms an interface between the audio circuit 110 and a detachable audio input / output peripheral device, such as a headset that has both an output (e.g., headphones for one or both ears) and an input (e.g., a microphone).

[0040] The I / O subsystem 106 connects input / output peripherals on device 100, such as the touchscreen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive / transmit electrical signals to and from the other input or control devices 116. The other input control devices 116 optionally include physical buttons (such as push buttons and rocker buttons), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controllers 160 are optionally coupled to or not coupled to any of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. One or more buttons (e.g., 208 in Figure 2) optionally include up / down buttons for volume control of speaker 111 and / or microphone 113. One or more buttons optionally include push buttons (e.g., 206 in Figure 2).

[0041] A quick press of a push button optionally initiates the process described in U.S. Patent Application No. 11 / 322,549, “Unlocking a Device by Performing Gestures on an Unlock Image,” filed December 23, 2005, U.S. Patent No. 7,657,849, which is incorporated herein by reference, either by selecting to unlock the touchscreen 112 or by using a gesture on the touchscreen to unlock the device. A longer press of a push button (e.g., 206) optionally turns the device 100 on or off. Any one or more functions of the buttons are optionally customizable by the user. The touchscreen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0042] The touch-sensitive display 112 constitutes an input interface and an output interface between the device and the user. As described above, the touch-sensing operation and display operation of the touch-sensitive display 112 are optionally separate from each other, so that the display device is used for display and the touch-sensitive surface (whether or not it is a display) is used for input detection, and the components and functions described are modified accordingly. However, for simplicity, the following description will be given in relation to the touch-sensitive display. The display controller 156 receives and / or transmits electrical signals to and from the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos and any combination thereof (collectively referred to as “images”). In some embodiments, some or all of the visual output corresponds to user interface objects.

[0043] The touchscreen 112 has a touch-sensing surface, sensor, or sensor set that receives user input based on touch and / or tactile contact. The touchscreen 112 and the display controller 156 (along with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of contact) on the touchscreen 112 and translate the detected contact into bidirectional interaction with user interface objects displayed on the touchscreen 112 (such as one or more soft keys, icons, web pages, or images). In one exemplary embodiment, the contact point between the touchscreen 112 and the user corresponds to the user's finger.

[0044] The touchscreen 112 optionally uses LCD (liquid crystal display) technology, LPD (polymer light-emitting display) technology, or LED (light-emitting diode) technology, but other technologies may be used in other embodiments. The touchscreen 112 and the display controller 156 optionally detect touch and any movement or interruption thereof using a plurality of currently known or future-developed touch sensing technologies, which non-limitingly include capacitive, resistive, infrared and surface acoustic wave technologies and other proximity sensor arrays or other elements for measuring one or more contact points with the touchscreen 112. In one exemplary embodiment, projected mutual capacitive sensing technology, such as that used in the iPhone®, iPod Touch®, and iPad® sold by Apple Inc. in Cupertino, California, is used.

[0045] In some embodiments, the touch-sensitive display of the touchscreen 112 is optionally similar to the multi-touch-sensitive touchpads described in U.S. Patent No. 6,323,846 (Westerman et al.), No. 6,570,557 (Westerman et al.) and / or No. 6,677,932 (Westerman) and / or U.S. Patent Application Publication No. 2002 / 0015024A1, each of which is incorporated by reference herein. However, the touchscreen 112 displays visual output from device 100, whereas the touch-sensitive touchpad does not provide visual output.

[0046] In some embodiments, the touch-sensitive display of the touchscreen 112 is provided for the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller"; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen"; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices"; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices"; (5) "Mode-Based Graphical User Interfaces For Touch Sensitive Input" filed January 18, 2005. (6) U.S. Patent Application No. 11 / 038,590 entitled “Devices”, (7) U.S. Patent Application No. 11 / 228,758 entitled “Virtual Input Device Placement On A Touch Screen User Interface”, filed September 16, 2005, (8) U.S. Patent Application No. 11 / 228,737 entitled “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”, filed September 16, 2005, and (9) U.S. Patent Application No. 11 / 367,749 entitled “Multi-Functional Hand-Held Device”, filed March 3, 2006. All of these applications are incorporated herein by reference in their entirety.

[0047] The touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. The user optionally touches the touchscreen 112 using any suitable object or accessory, such as a stylus or finger. In some embodiments, the user interface is designed to operate primarily by finger touch and gestures, which may be less precise than stylus input due to the larger contact area of ​​the finger on the touchscreen. In some embodiments, the device converts low-precision finger input into high-precision pointer / cursor positions or commands to perform the action desired by the user.

[0048] In some embodiments, the device 100 optionally has a touchpad (not shown) in addition to the touchscreen to activate or deactivate specific functions. In some embodiments, the touchpad is a touch-sensing area of ​​the device that, unlike the touchscreen, does not display a visual output. The touchpad is optionally a touch-sensing surface separate from the touchscreen 112, or an extension of the touch-sensing surface formed by the touchscreen.

[0049] Device 100 further comprises a power system 162 for supplying power to various components. The power system 162 optionally comprises a power management system, one or more power sources (such as a battery, alternating current (AC), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (such as a light-emitting diode (LED)), and any other components related to the generation, management, and distribution of power in portable or non-portable devices.

[0050] Device 100 further optionally has one or more optical sensors 164. Figure 1A illustrates an optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally has a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment, illuminated through one or more lenses, and converts this light into data representing an image. The optical sensor 164 works in cooperation with an imaging module 143 (also called a camera module) to optionally capture still images or video images. In some embodiments, the optical sensor is located on the back side of Device 100, opposite the touchscreen display 112 on the front side of the device, so that the touchscreen display can be used as a viewfinder for acquiring still and / or video images. In some embodiments, the optical sensor is located on the front side of the device so that the user can see other participants in a video conference on the touchscreen display, while the user's image is optionally acquired for video conferencing. In some embodiments, the position of the optical sensor 164 can be changed by the user (for example, by rotating the lens and sensor within the device housing) so that a single optical sensor 164 can be used with a touchscreen display for both video conferencing and the acquisition of still and / or video images.

[0051] Device 100 further optionally has one or more contact strength sensors 165. Figure 1A illustrates a contact strength sensor coupled to a strength sensor controller 159 in the I / O subsystem 106. The contact strength sensor 165 optionally has one or more strength sensors, such as a piezoresistive strain gauge, a capacitive force sensor, an electric force sensor, a pressure-power sensor, an optical force sensor, a capacitive touch-sensing surface, or other sensors (such as sensors used to measure the force (or pressure) of contact with a touch-sensing surface). The contact strength sensor 165 receives contact strength information from the environment (such as pressure information or a substitute for pressure information). In some embodiments, at least one contact strength sensor is located adjacent to or near a touch-sensing surface (such as a touch-sensing display system 112). In some embodiments, at least one contact strength sensor is located on the back side of Device 100, opposite to the touchscreen display 112 located on the front side of Device 100.

[0052] Device 100 further optionally has one or more proximity sensors 166. Figure 1A illustrates a proximity sensor 166 coupled to a peripheral interface 118. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in the I / O subsystem 106. The proximity sensor 166 operates selectively as described in U.S. Patent Application No. 11 / 241,839, entitled “Proximity Detector In Handheld Device”, U.S. Patent Application No. 11 / 240,788, entitled “Proximity Detector In Handheld Device”, U.S. Patent Application No. 11 / 620,702, entitled “Using Ambient Light Sensor To Augment Proximity Sensor Output”, U.S. Patent Application No. 11 / 586,862, entitled “Automated Response To And Sensing Of User Activity In Portable Devices”, and U.S. Patent Application No. 11 / 638,251, entitled “Methods And Systems For Automatic Configuration Of Peripherals”. In some embodiments, the proximity sensor is turned off and the touchscreen 112 is disabled when the multifunction device is positioned near the user’s ear (for example, when the user is on a phone call).

[0053] Device 100 further optionally has one or more tactile output generators 167. Figure 1A illustrates a tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally has one or more electroacoustic devices, such as a speaker or other audio component, and / or a tactile output component, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other component that converts energy into linear motion (such as a component that converts an electrical signal into a tactile output on the device). A contact intensity sensor 165 receives a tactile feedback generation command from the tactile feedback module 133 and generates a tactile output on device 100 that can be sensed by the user of device 100. In some embodiments, at least one tactile output generator is positioned adjacent to or near a touch-sensing surface (such as a touch-sensing display system 112) and optionally generates a tactile output by moving the touch-sensing surface vertically (e.g., closer to / away from the surface of device 100) or laterally (e.g., back and forth within the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back side of device 100, opposite to the touchscreen display 112 located on the front side of device 100.

[0054] Device 100 further optionally includes one or more accelerometers 168. Figure 1A illustrates an accelerometer 168 coupled to a peripheral device interface 118. Alternatively, an accelerometer 168 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The accelerometers 168 operate optionally as described in U.S. Patent Application Publication No. 20050190059, “Acceleration-based Theft Detection System for Portable Electronic Devices,” and U.S. Patent Application Publication No. 20060017692, “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated herein by reference. In some embodiments, information is displayed on a touchscreen display in portrait or landscape orientation based on an analysis of data received from one or more accelerometers. In addition to the accelerometer 168, device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for acquiring information about the position and orientation (such as whether it is vertical or horizontal) of device 100.

[0055] In some embodiments, the software components stored in memory 102 include an operating system 126, a communications module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, memory 102 (Figure 1A) or 370 (Figure 3) stores device / global internal state 157, as shown in Figures 1A and 3. The device / global internal state 157 includes any one or more of the following: active application state, indicating which application, view, or other information is currently active if any applications exist; display state, indicating which applications, views, or other information occupy various areas of the touchscreen display 112; sensor state, including information obtained from various sensors and input control devices 116 of the device; and positional information relating to the device's position and / or orientation.

[0056] An operating system 126 (such as embedded operating systems like Darwin, RTXC, LINUX, UNIX®, OS X, iOS, WINDOWS®, or VxWorks) has various software components and / or drivers for controlling and managing common system tasks (such as memory management, storage control, and power management), and facilitates communication between various hardware and software components.

[0057] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuit 108 and / or external ports 124. The external ports 124 (such as Universal Serial Bus (USB), Fireware, etc.) are configured to connect directly or indirectly to other devices via a network (such as the Internet, Wi-Fi, etc.). In some embodiments, the external ports are multi-pin connectors (such as 30-pin) that are identical to, or similar to and / or compatible with, the 30-pin connector used on iPod (a registered trademark of Apple Inc.) devices.

[0058] The contact / motion module 130 optionally detects contact with the touchscreen 112 and other touch-sensing devices (such as a touchpad or physical click wheel) (in cooperation with the display controller 156). The contact / motion module 130 has various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger being lowered), determining the intensity of contact (e.g., the force or pressure of contact or a substitute for the force or pressure of contact), determining whether there is motion in the contact (e.g., detecting a drag event by one or more fingers), tracking this motion on the touch-sensing surface, and determining the end of contact (e.g., a finger being lifted or an interruption of contact). The contact / motion module 130 receives contact data from the touch-sensing surface. The determination of the motion of the contact point, represented by a series of contact data, optionally includes the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions are optionally applied to a single contact (such as a single finger touch) or multiple simultaneous contacts (such as "multi-touch" / multiple finger touches). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact with the touchpad.

[0059] In some embodiments, the contact / motion module 130 determines whether a certain action has been performed by the user (for example, whether the user has "clicked" an icon) using one or more intensity threshold sets. In some embodiments, at least one subset of the intensity thresholds is determined according to software parameters (for example, the intensity thresholds are not determined by the activation threshold of a particular physical actuator, but are adjustable without changing the physical hardware of the device 100). For example, the mouse "click" threshold of a trackpad or touchscreen display can be set to one of a range of predetermined thresholds without changing the trackpad or touchscreen display hardware. In addition, in some embodiments, software settings are provided to the user of the device for adjusting any one or more of the intensity threshold sets (for example, by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using a system-level click "intensity" parameter).

[0060] The contact / motion module 130 selectively detects gesture input from the user. Different gestures on a touch-sensitive surface have different contact patterns (such as different movement, timing, and / or intensity of the detected contact). Thus, gestures are selectively detected by detecting specific contact patterns. For example, a finger tap gesture may involve detecting a finger lift-off event after a finger lowering event, at the same (or substantially the same) position as the finger lowering event (e.g., the position of an icon). Another example is detecting a finger swipe gesture on a touch-sensitive surface, which may involve detecting a finger lowering event, followed by a drag event by one or more fingers, and then a finger lift-off event.

[0061] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other display, including components for modifying the appearance of the displayed graphics (such as brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term “graphics” includes any object that can be displayed to the user, not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0062] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. After receiving one or more codes specifying the graphics to be displayed, and coordinate data and other graphic characteristic data as needed, from an application or the like, the graphics module 132 generates screen image data to be output to the display controller 156.

[0063] The haptic feedback module 133 has various software components for generating commands used by the haptic output generator 167 to generate haptic outputs at one or more locations on the device 100 in response to user interaction with the device 100.

[0064] Optionally, the text input module 134, which is a component of the graphics module 132, provides a soft keyboard for entering text within various applications (such as contacts 137, email 140, IM 141, browser 147, and any other applications that require text input).

[0065] The GPS module 135 determines the location of the device and provides this information for use in various applications (for example, to the telephone 138 for use in location-based dialing, to the camera 143 as photo / video metadata, and to applications that provide location-based services such as weather widgets, local phonebook widgets, and map / navigation widgets).

[0066] Application 136 optionally includes the following modules (or instruction sets), or subsets or supersets thereof: • Contact module 137 (sometimes called the address book or contact list), • Telephone module 138, • Video conferencing module 139, • Email client module 140, • Instant messaging (IM) module 141, • Training support module 142, • Camera module 143 for still images and / or video images, Image management module 144, • Video playback device module, • Music player module, • Browser module 147, Calendar module 148, A widget module 149 that optionally includes one or more widgets obtained by the user, such as weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other user-obtained widgets and user-created widgets 149-6. • Widget creator module 150 for creating user-created widgets 149-6. • Search module 151, • Video and music player module 152 integrating a video playback module and a music player module. • Memo module 153, • Map module 154, and / or • Online video module 155.

[0067] Examples of other applications 136 that are optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java®-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0068] In combination with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (stored, for example, in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including adding names to the address book, deleting names from the address book, associating names with telephone numbers, email addresses, physical addresses or other information, associating names with images, classifying and sorting names, and presenting telephone numbers or email addresses to initiate and / or facilitate communication via telephone 138, video conferencing module 139, email 140, or IM 141, etc.

[0069] In combination with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the telephone module 138 is optionally used for inputting a series of characters corresponding to a telephone number, accessing one or more telephone numbers in the contact module 137, changing entered telephone numbers, dialing each telephone number, conducting a conversation, and disconnecting or canceling the call at the end of the conversation. As described above, the wireless communication optionally uses any of several communication standards, protocols, and technologies.

[0070] In combination with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, the video conferencing module 139 has executable commands for starting, running, and ending a video conference between the user and one or more other participants, according to the user's commands.

[0071] Combined with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the email client module 140 has executable commands for creating, sending, receiving, and managing emails in response to user commands. Combined with the image management module 144, the email client module 140 makes it very easy to create and send emails with still or video images captured using the camera module 143.

[0072] In combination with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the instant messaging module 141 has executable commands for inputting a series of characters corresponding to an instant message, modifying previously entered characters, sending each instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for telephone-based instant messaging or XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, sent and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported by MMS and / or Enhanced Messaging Services (EMS). As used herein, the term “instant messaging” refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0073] Combined with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 has executable commands for creating training (with, for example, time, distance, and / or calorie consumption targets), communicating with training sensors (sports devices), receiving training sensor data, calibrating sensors used to monitor training, selecting and playing music for training, and displaying, storing, and transmitting training data.

[0074] In combination with the touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 has executable commands for capturing still images or video images (including video streams) and storing them in memory 102, modifying the characteristics of still images or video images, or deleting still images or video images from memory 102.

[0075] Together with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable commands for arranging, modifying (e.g., editing), manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0076] Together with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the browser module 147 includes executable commands for browsing the Internet in accordance with user commands, including searching, linking, receiving, and displaying web pages or parts thereof, as well as attachments and other files linked to web pages.

[0077] Together with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar entries, to-do list, etc.) in accordance with user instructions.

[0078] Along with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extended Markup Language) file and a JavaScript file (e.g., Yahoo! Widget).

[0079] Along with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget creation module 150 is optionally used by the user to create widgets (for example, to convert a user-specified portion of a web page into a widget).

[0080] Together with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching for characters, music, sounds, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0081] Together with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music player module 152 includes executable commands that enable the user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable commands for displaying, presenting, or playing video (for example, on the touchscreen 112 or on an external display connected via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0082] Together with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the memo module 153 includes executable commands for creating and managing memos, to-do lists, etc., according to user commands.

[0083] Together with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and map-associated data (e.g., driving instructions, data for specific locations or nearby stores and other points of interest) in accordance with user commands.

[0084] Together with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions that enable the user to access, view, receive (e.g., by streaming and / or downloading), play (e.g., on the touchscreen or on an external display connected via external port 124), send, and otherwise manage online videos in one or more file formats such as H.264 via links to specific online videos. In some embodiments, the instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Further descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed June 20, 2007, and U.S. Patent Application No. 11 / 968,067, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed December 31, 2007, the contents of which are incorporated herein by reference to their entirety.

[0085] Each of the modules and applications identified above corresponds to a set of executable instructions for performing one or more of the functions described above and the methods described in this application (e.g., the computer-based methods and other information processing methods described herein). These modules (e.g., instruction sets) do not need to be implemented as separate software programs, procedures, or modules; therefore, various subsets of these modules may be optionally combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module to form a single module (e.g., the video and music player module 152 in Figure 1A). In some embodiments, memory 102 may optionally store a subset of the modules and data structures identified above. Furthermore, memory 102 may optionally store additional modules and data structures not described above.

[0086] In some embodiments, device 100 is a device in which the operation of a predetermined set of functions on the device is performed exclusively via a touchscreen and / or touchpad. By using the touchscreen and / or touchpad as the primary input control device for the operation of device 100, the number of physical input control devices (push buttons, dials, etc.) on device 100 is optionally reduced.

[0087] A predetermined set of functions performed exclusively via the touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, home menu, or root menu. In such embodiments, a “menu button” is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.

[0088] Figure 1B is a block diagram showing exemplary components for event processing according to several embodiments. In some embodiments, memory 102 (Figure 1A) or 370 (Figure 3) includes an event sorter 170 (e.g., within the operating system 126) and each application 136-1 (e.g., any of the aforementioned applications 137-151, 155, 380-390).

[0089] The event sorter 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 that transmit the event information. The event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates the current application view displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, a device / global internal state 157 is used by the event sorter 170 to determine which application is currently active, and the application internal state 192 is used by the event sorter 170 to determine the application view 191 that transmits the event information.

[0090] In some embodiments, the application internal state 192 includes additional information such as resume information used when the application 136-1 resumes execution, user interface state information indicating what is being displayed or ready to be displayed by the application 136-1, a state queue to allow the user to return to a previous state or view of the application 136-1, and any one or more queues to redo / undo previous actions taken by the user.

[0091] The event monitor 171 receives event information from the peripheral interface 118. The event information includes information about sub-events (for example, a user touching the touch-sensitive display 112 as part of a multi-touch gesture). The peripheral interface 118 transmits information received from the I / O subsystem 106 or sensors such as the proximity sensor 166, accelerometer 168, and / or microphone 113 (via the audio circuit 110). The information received by the peripheral interface 118 from the I / O subsystem 106 includes information from the touch-sensitive display 112 or touch-sensitive surface.

[0092] In some embodiments, the event monitor 171 sends a request to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 transmits event information. In other embodiments, the peripheral interface 118 transmits event information only when there is a critical event (for example, when the input is received over a period exceeding a predetermined noise threshold and / or a predetermined duration).

[0093] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognition determination module 173.

[0094] The hit view determination module 172 provides software procedures for determining where in one or more views a sub-event occurred when the touch-sensitive display 112 displays multiple views. A view consists of controls and other elements that the user can display on the display.

[0095] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as an application view or user interface window, where information is displayed and touch-based gestures occur. The application view (of each application) in which a touch is detected optionally corresponds to a program level within the application's program hierarchy or view hierarchy. For example, the lowest level view in which a touch is detected is optionally called a hit view, and the set of events recognized as appropriate input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch-based gesture.

[0096] The hit view determination module 172 receives information about sub-events of touch-based gestures. If the application has multiple views organized hierarchically, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchy from which the sub-events should be processed. In most cases, the hit view is the lowest-level view from which the initial sub-event occurs (e.g., the first sub-event in a set of sub-events that form an event or potential event). Once a hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events associated with the same touch or input source from which it was identified as a hit view.

[0097] The active event recognition determination module 173 determines which view or a group of views in the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition determination module 173 determines that all views, including the physical location of the sub-event, are actively involved views, and therefore all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is entirely confined to a region associated with one particular view, higher-level views in the hierarchy will still remain actively involved views.

[0098] The event dispatcher module 174 transmits event information to an event recognition unit (e.g., an event recognition unit 180). In embodiments including an active event recognition unit determination module 173, the event dispatcher module 174 transmits the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information acquired by each event receiving unit 182 in an event queue.

[0099] In some embodiments, the operating system 126 includes an event sorter 170. Alternatively, application 136-1 includes an event sorter 170. In yet another embodiment, the event sorter 170 is a standalone module or part of another module stored in memory 102, such as a contact / motion module 130.

[0100] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within each view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, any one or more of the event recognition units 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes any one or more event data 179 received from a data updater 176, an object updater 177, a GUI updater 178, and / or an event sorter 170. The event handler 190 optionally utilizes or calls the data updater 176, object updater 177, or GUI updater 178 to update the application's internal state 192. Alternatively, any one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, any one or more of the data updater 176, object updater 177, and GUI updater 178 are included in the respective application views 191.

[0101] Each event recognition unit 180 receives event information (e.g., event data 179) from the event sorter 170 and identifies events from the event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparison unit 184. In some embodiments, the event recognition unit 180 also includes metadata 183 and at least a subset of event transmission commands 188 (optionally including sub-event transmission commands).

[0102] The event receiving unit 182 receives event information from the event sorter 170. The event information includes information about sub-events, such as touches or touch movements. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. If the sub-event relates to a touch movement, the event information also optionally includes the velocity and direction of the sub-event. In some embodiments, an event includes a rotation of the device from one orientation to another (for example, from portrait to landscape, or vice versa), and the event information includes corresponding information about the device's current orientation (also called device orientation).

[0103] The event comparison unit 184 compares event information with a predetermined event or sub-event definition and, based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes an event definition (e.g., a predetermined set of sub-events), e.g., event 1 (187-1), event 2 (187-2), etc. In some embodiments, the sub-events (187) within an event include, for example, touch start, touch end, touch move, touch cancel, and multiple touches. In one example, the definition of event 1 (187-1) is a double tap on a displayed object. A double tap includes, for example, a first touch (touch start) on the displayed object for a predetermined phase, a first lift-off (touch end) for a predetermined phase, a second touch (touch start) on the displayed object for a predetermined phase, and a second lift-off (touch end) for a predetermined phase. In another example, the definition of event 2 (187-2) is a drag on a displayed object. A drag includes, for example, touching (or contacting) a display object for a predetermined phase, moving a touch across the touch-sensitive display 112, and lifting off (ending) the touch. In some embodiments, the event also includes information about one or more associated event handlers 190.

[0104] In some embodiments, the event definition 187 includes an event definition for each user interface object. In some embodiments, the event comparison unit 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view where three user interface objects are displayed on a touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, the event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with its own event handler 190, the event comparison unit uses the results of the hit test to determine which event handler 190 should be activated. For example, the event comparison unit 184 selects an event handler associated with the sub-event and the object that triggers the hit test.

[0105] In some embodiments, the definition of each event (187) also includes a delay action that delays the transmission of event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognition unit.

[0106] If each event recognition unit 180 determines that a series of sub-events does not match any of the events in the event definition 186, the event recognition unit 180 transitions to an event impossible, event failed, or event terminated state and then ignores subsequent sub-events of the touch-based gesture. In this situation, any other event recognition units that remain active for the hit view continue to track and process the sub-events of the ongoing touch-based gesture.

[0107] In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists indicating how the event transmission system should perform sub-event transmission to the event recognition units actively involved. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating how the event recognition units interact with each other, or are made capable of interacting with each other. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating whether sub-events are transmitted to various levels within a view or program hierarchy.

[0108] In some embodiments, each event recognition unit 180 invokes an event handler 190 associated with an event when one or more specific sub-events of an event are recognized. In some embodiments, each event recognition unit 180 transmits event information associated with that event to the event handler 190. Invoking an event handler 190 is different from sending (and delaying) the sub-events to their respective hit views. In some embodiments, the event recognition unit 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and executes a predetermined process.

[0109] In some embodiments, the event transmission instruction 188 includes a sub-event transmission instruction that transmits event information about a sub-event without invoking an event handler. Instead, the sub-event transmission instruction transmits the event information to an event handler or actively involved view associated with a set of sub-events. The event handler associated with the set of sub-events or actively involved view receives the event information and executes a predetermined process.

[0110] In some embodiments, the data updater 176 creates and updates data used in application 136-1. For example, the data updater 176 updates telephone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, the object updater 177 creates and updates objects used in application 136-1. For example, the object updater 177 creates new user interface objects or updates the positions of user interface objects. The GUI updater 178 updates the GUI. For example, the GUI updater 178 prepares display information and sends it to graphics module 132 for display on touch-sensitive display.

[0111] In some embodiments, the event handler 190 includes or has access to the data updater 176, the object updater 177, and the GUI updater 178. In some embodiments, the data updater 176, the object updater 177, and the GUI updater 178 are contained in a single module of their respective applications 136-1 or application view 191. In other embodiments, they are contained in two or more software modules.

[0112] The above description of event processing for user touch on a touch-sensitive display should also be understood to apply to other forms of user input for operating the multifunction device 100 using input devices, although these do not originate on the touchscreen. For example, mouse movement or mouse button presses, optional coordination with pressing or holding one or more keyboard keys, touch / movement such as tapping, dragging, and scrolling on a touchpad, pen stylus input, device movement, verbal commands, detected eye movements, biometric input, and / or any combination thereof may be optionally used as inputs corresponding to sub-events that define the events to be recognized.

[0113] Figure 2 shows portable or non-portable multifunctional devices 100 having a touchscreen 112 according to several embodiments. As described above, the multifunctional device 100 has been described as having various exemplary structures (such as the touchscreen 112, speaker 111, accelerometer 168, and microphone 113), however, it is understood that these structures may optionally reside in separate devices. For example, display-related structures (e.g., display, speaker, etc.) and / or functions may optionally reside on a separate display device, input-related structures (e.g., touch-sensitive surface, microphone, accelerometer, etc.), and / or functions may optionally reside on a separate input device, and the remaining structures and / or functions may optionally reside on the multifunctional device 100.

[0114] The touchscreen 112 optionally displays one or more graphics within the user interface (UI) 200. In this embodiment, as in other embodiments described later, the user can select any one or more of the graphics by making gestures on the graphics using, for example, one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, the selection of one or more graphics occurs when the user interrupts contact with one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (left to right, right to left, up and / or down) and / or finger rotations (right to left, left to upper right and / or down) in contact with the device 100. In some implementations or situations, accidental contact with a graphic does not result in the selection of a graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture swiping over an application icon optionally does not result in the selection of the corresponding application.

[0115] Device 100 also optionally includes one or more physical buttons, such as a "Home" or menu button 204. As previously mentioned, the menu button 204 is optionally used to navigate to any application 136 in a set of applications running on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touchscreen 112.

[0116] In one embodiment, device 100 includes a touchscreen 112, a menu button 204, a push button 206 for turning the device on / off and locking the device, volume control buttons 208, a subscriber identification module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing and holding the button for a predetermined time interval, to lock the device by pressing and releasing the button before the predetermined time interval has elapsed, and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, device 100 also accepts verbal input via a microphone 113 for enabling or disabling several functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more tactile output generators 167 for generating tactile output for the user of device 100.

[0117] Figure 3 is a block diagram of an exemplary multifunctional device having a display and touch-sensitive surface according to several embodiments. Device 300 does not necessarily have to include a display and touch-sensitive surface as described above, but in some embodiments, it optionally communicates with a display and touch-sensitive surface on another device. Furthermore, device 300 does not need to be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device (such as a television or set-top box), navigation device, educational device (such as a children's learning toy), game system, or control equipment (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication buses 320 optionally include circuits (C) that interconnect and control communication between system components. The device 300 includes an input / output (I / O) interface 330, which includes a display 340, typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the tactile output generator 167 described above with reference to Figure 1A), and a sensor 359 (e.g., an optical, accelerometer, proximity, touch-sensitive, and / or contact intensity sensor, similar to the contact intensity sensor 165 described above with reference to Figure 1A). The memory 370 includes high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid memory devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to those stored in memory 102 of the portable or non-portable multifunction device 100 (Figure 1A), or a subset thereof. Furthermore, memory 370 optionally stores additional programs, modules, and data structures that are not present in memory 102 of the portable or non-portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, while memory 102 of the portable or non-portable multifunction device 100 (Figure 1A) optionally does not store these modules.

[0118] In Figure 3, each of the identified elements is optionally stored in any one or more of the aforementioned memory devices. Each of the identified modules corresponds to an instruction set that performs the function described above. The identified modules or programs (e.g., instruction sets) do not need to be implemented as separate software programs, procedures, or modules; therefore, various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the identified modules and data structures. Furthermore, memory 370 optionally stores additional modules and data structures not described above.

[0119] Figure 4 shows an exemplary user interface on a device (e.g., device 300 in Figure 3) having a touch-sensitive surface 451 (e.g., tablet or touchpad 355 in Figure 3) separate from the display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., any one or more of sensors 357) for detecting the intensity of contact on the touch-sensitive surface 451 and / or one or more tactile output generators 359 for generating tactile output for the user of device 300.

[0120] Some of the following examples are given with reference to input on a touchscreen display 112 (where a touch-sensing surface and a display are combined), but in some embodiments, the device detects input on a touch-sensing surface separate from the display, as shown in Figure 4. In some embodiments, the touch-sensing surface (e.g., 451 in Figure 4) has a primary axis (e.g., 452 in Figure 4) corresponding to a primary axis (e.g., 453 in Figure 4) on the display (e.g., 450). According to these embodiments, the device detects contact (e.g., 460 and 462 in Figure 4) with the touch-sensing surface 451 at locations corresponding to each location on the display (e.g., 460 corresponds to 468 and 462 corresponds to 470 in Figure 4). In this way, user input (e.g., contacts 460 and 462, and their movement) detected by the device on the touch-sensing surface (e.g., 451 in Figure 4) is used by the device to operate the user interface on the display of the multifunction device (e.g., 450 in Figure 4) when the touch-sensing surface is separate from the display. It should be understood that similar methods may be used, at their discretion, for other user interfaces described herein.

[0121] Furthermore, while the following examples are given primarily in relation to finger input (e.g., finger touch, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, any one or more of the finger inputs may be replaced by input from other input devices (e.g., mouse-based input or stylus input). For example, a swipe gesture may be optionally replaced by a mouse click (e.g., instead of touch) followed by cursor movement along the swipe path (e.g., instead of touch movement). As another example, a tap gesture may be optionally replaced by a mouse click (e.g., instead of ceasing to detect touch after detecting touch) while the cursor is over the tap gesture's position. Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may be optionally used simultaneously, or a mouse and finger touch may be optionally used simultaneously.

[0122] As used herein, the term “focus selector” refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations, including a cursor or other position marker, the cursor functions as a “focus selector,” and as a result, when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., the touchpad 355 in Figure 3 or the touch-sensitive surface 451 in Figure 4) and the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), that particular user interface element adjusts according to the detected input. In some implementations, including a touchscreen display that enables direct interaction with user interface elements on the touchscreen display (e.g., the touch-sensitive display system 112 in Figure 1A), detected contact on the touchscreen functions as a “focus selector,” and as a result, when input (e.g., a press input by touch) is detected on the touchscreen display at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element), that particular user interface element adjusts according to the detected input. In some implementations, focus is moved from one area of ​​the user interface to another without corresponding cursor movement or touch movement on the touchscreen display (for example, by using the tab key or arrow keys to move focus from one button to another). In these implementations, the focus selector moves in accordance with the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or touch on the touchscreen display) controlled by the user to communicate the user's intended interaction with the user interface (for example, by pointing the device to the user interface element with which the user intends to interact).For example, the position of the focus selector (e.g., cursor, touch, or selection box) on each button while a press input is detected on a touch-sensitive surface (e.g., touchpad or touchscreen) indicates that the user intends to activate that button (as opposed to other user interface elements displayed on the device's display).

[0123] As used herein and in the claims, the term “characteristic intensity” of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples for a given event (e.g., after detection of contact, before detection of lift-off of contact, before or after detection of the start of movement of contact, before detection of the end of contact, before or after detection of an increase in contact intensity, and / or before or after detection of a decrease in contact intensity), or on a set of intensity samples collected during a given period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds). The characteristic intensity of a contact is optionally based on any one or more of the following: the maximum intensity of contact, the average intensity of contact, the top 10 percentile values ​​of contact intensity, half the maximum intensity of contact, 90 percent of the maximum intensity of contact, etc. In some embodiments, the duration of contact is used to determine the characteristic intensity (for example, when the characteristic intensity is the average of the contact intensity over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether the operation was performed by a user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, contact with a characteristic intensity not exceeding the first threshold results in a first action, contact with a characteristic intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a characteristic intensity exceeding the second threshold results in a third action. In some embodiments, the comparison between the characteristic intensity and one or more thresholds is used to determine whether to perform one or more actions (e.g., whether to perform each action or refrain from performing each action), rather than to determine whether to perform the first or second action.

[0124] In some embodiments described herein, one or more actions are performed in response to the detection of a gesture including each pressing input, or in response to the detection of each pressing input performed by each (or more) contact, and each pressing input is detected at least in part on the detection of an increase in the intensity of the contact (or more) above a pressing input intensity threshold. In some embodiments, each action is performed in response to the detection of an increase in the intensity of each contact above a pressing input intensity threshold (e.g., a "downward stroke" of each pressing input). In some embodiments, the pressing input includes an increase in the intensity of each contact above a pressing input intensity threshold, and a subsequent decrease in the intensity of the contact below the pressing input intensity threshold, and each action is performed in response to the detection of a subsequent decrease in the intensity of each contact below the pressing input threshold (e.g., an "upward stroke" of each pressing input).

[0125] In some embodiments, the device uses intensity hysteresis to avoid accidental inputs, sometimes referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship to a pressing input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the pressing input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or a reasonable percentage of the pressing input intensity threshold). Thus, in some embodiments, the pressing input includes an increase in intensity of each contact above the pressing input intensity threshold, and a decrease in intensity of the subsequent contact below the hysteresis intensity threshold corresponding to the pressing input intensity threshold, with each action performed in response to the detection of the subsequent decrease in intensity of each contact below the hysteresis intensity threshold (e.g., an “upward stroke” of each pressing input). Similarly, in some embodiments, a press input is detected only when the device optionally detects an increase in contact intensity from below a hysteresis intensity threshold to above a press input intensity threshold, and a subsequent decrease in contact intensity to below the hysteresis intensity, and each action is performed in response to the detection of a press input (e.g., depending on the situation, an increase in contact intensity or a decrease in contact intensity).

[0126] For simplicity of explanation, the description of an action performed in response to a press input associated with a press input intensity threshold, or in response to a gesture involving a press input, is optionally triggered in response to the detection of any of the following: an increase in contact intensity exceeding the press input intensity threshold, an increase in contact intensity from below the hysteresis intensity threshold to above the press input intensity threshold, a decrease in contact intensity below the press input intensity threshold, and / or a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press input intensity threshold. Furthermore, in an example where it is stated that an action is performed in response to the detection of a decrease in contact intensity below the press input intensity threshold, the action is optionally performed in response to the detection of a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press input intensity threshold.

[0127] Figure 5A shows a block diagram of an exemplary architecture for a device 500 according to some embodiments of the present disclosure. In the embodiment of Figure 5A, media or other content is optionally received by the device 500 via a network interface 502 which is optionally wireless or wired. Any one or more of the processors 504 optionally execute any number of programs stored in memory 506 or a storage device which optionally include instructions to execute any one or more of the methods and / or processes described herein (e.g., method 700).

[0128] In some embodiments, a display controller 508 causes the various user interfaces of this disclosure to be displayed on a display 514. Furthermore, input to device 500 is optionally provided by a remote device 510 via a remote interface 512, which is optionally wireless or wired. In some embodiments, input to device 500 is provided by a multifunction device 511 (e.g., a smartphone) running a remote control application that configures the multifunction device to simulate remote control functionality, as will be described in more detail below. In some embodiments, the multifunction device 511 corresponds to any one or more of the devices 100 in Figures 1A and 2, and the device 300 in Figure 3. The embodiment in Figure 5A is not intended to limit the features of the devices of this disclosure, and it is understood that other components to facilitate other features described in this disclosure are optionally included in the architecture of Figure 5A.In some embodiments, device 500 optionally corresponds to any one or more of the multifunction device 100 in Figures 1A and 2 and device 300 in Figure 3; network interface 502 optionally corresponds to any one or more of the RF circuit 108, external port 124, and peripheral device interface 118 in Figures 1A and 2, and network communication interface 360 ​​in Figure 3; processor 504 optionally corresponds to any one or more of the processor 120 in Figure 1A and CPU 310 in Figure 3; display controller 508 optionally corresponds to any one or more of the display controller 156 in Figure 1A and I / O interface 330 in Figure 3; memory 506 optionally corresponds to any one or more of the memory 102 in Figure 1A and memory 370 in Figure 3; remote interface 512 optionally The remote 512, which selectively corresponds to any one or more of the peripheral device interface 118 and I / O subsystem 106 (and / or its components) in Figure 1A, and the I / O interface 330 in Figure 3, optionally corresponds to any one or more of the speaker 111, touch-sensitive display system 112, microphone 113, light sensor 164, contact intensity sensor 165, tactile output generator 167, other input control device 116, accelerometer 168, proximity sensor 166, and I / O subsystem 106 in Figure 1A, and the keyboard / mouse 350, touchpad 355, tactile output generator 357, and contact intensity sensor 359 in Figure 3, and the touch-sensitive surface 451 in Figure 4, optionally corresponds to any one or more of the touch-sensitive display systems 112 in Figures 1A and 2, and the display 340 in Figure 3.

[0129] Figure 5B shows an exemplary structure of a remote 510 according to some embodiments of the present disclosure. In some embodiments, the remote 510 optionally corresponds to any one or more of the multifunction device 100 in Figures 1A and 2 and the device 300 in Figure 3. The remote 510 optionally includes a touch-sensing surface 451. In some embodiments, the touch-sensing surface 451 is edge-to-edge (for example, as shown in Figure 5B, it extends to the edge of the remote 510 such that there is little or no surface of the remote 510 between the touch-sensing surface 451 and one or more edges of the remote 510). As previously stated in the present disclosure, the touch-sensing surface 451 can optionally sense contact and contact intensity (e.g., a click of the touch-sensing surface 451). Furthermore, the touch-sensing surface 451 optionally includes a mechanical actuator for providing a physical button-click function (for example, the touch-sensing surface 451 is "clickable" to provide a corresponding input to the device 500). The remote 510 also optionally includes buttons 516, 518, 520, 522, 524, and 526. The buttons 516, 518, 520, 522, 524, and 526 are optionally mechanical buttons or substitutes for mechanical buttons that can sense contact or presses to initiate corresponding actions on device 500. In some embodiments, the user's selection of the “Menu” button 516 navigates device 500 backward in the currently running application or currently displayed user interface (e.g., back to a user interface displayed before the currently displayed user interface), or navigates device 500 to a user interface one level higher than the currently displayed user interface. In some embodiments, the user's selection of the “Home” button 518 navigates device 500 from any user interface displayed on device 500 to the main, home, or root user interface (e.g., the home screen of device 500, which optionally includes one or more applications accessible on device 500).In some embodiments, the user's selection of the “Play / Pause” button 520 toggles playback and pause of the content item currently playing on device 500 (for example, if a content item is playing on device 500 when the “Play / Pause” button 520 is selected, the content item is optionally paused, and if a content item is paused on device 500 when the “Play / Pause” button 520 is selected, the content item is optionally played). In some embodiments, the user's selection of the “+” 522 button or the “-” 524 button increases or decreases the volume of the audio played by device 500 (for example, the volume of the content item currently playing on device 500), respectively. In some embodiments, the user's selection of the “Audio Input” button 526 allows the user to provide audio input (for example, voice input) to device 500, optionally to a voice assistant on the device. In some embodiments, the remote 510 includes a microphone for the user to provide audio input to device 500 when the “Audio Input” button 526 is selected. In some embodiments, the remote 510 includes one or more accelerometers for detecting information regarding the movement of the remote. User interface and related processes Integrated media browsing interface

[0130] A user interacts with an electronic device in many different ways, including with media that may be available on the electronic device (e.g., stored or otherwise accessible) (e.g., music, movies, etc.) (as described with respect to Figures 6A-6LL, 8A-8GG, 10A-10Z, 12A-12V, and / or 18A-18J). For example, a user can browse and play media accessible on an electronic device. In some situations, such media may be available through various media applications installed on the electronic device. For example, a first media application on the electronic device may optionally provide access to media from a first media provider, and a second media application on the electronic device may optionally provide access to media from a second media provider. However, in some situations, the user may have to browse media separately from each media application (and thus provider), and instead, the user may want to browse media from different media applications within an integrated media browsing user interface. The embodiments described below provide a way for an electronic device to enhance a user's interaction with the electronic device by presenting the user with recommended media items (e.g., movies, TV shows, etc.) from different media applications within an integrated media browsing application. This enhanced interaction reduces the time required for the user to perform actions, thereby reducing the device's power consumption and extending the battery life of battery-powered devices. It is understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.

[0131] Figures 6A–6LL illustrate exemplary methods by which an electronic device presents recommended media items (e.g., movies, TV shows, etc.) to a user in an integrated media browsing application, according to some embodiments of the present disclosure. Embodiments in these figures are used to illustrate the processes described below, including the processes described with reference to Figures 7A–7L.

[0132] Figure 6A shows an exemplary display 514. The display 514 optionally displays one or more user interfaces containing various content. In the example shown in Figure 6A, the display 514 displays an integrated media browsing application that is either part of the display 514 or runs on an electronic device to which the display 514 is connected (e.g., electronic device 500 in Figure 5A). The electronic device optionally accesses various media items (e.g., movies, TV shows, songs, etc.) through various media applications installed on the electronic device, which provide the electronic device with access to media from corresponding media providers (e.g., a first application corresponding to a first media provider provides the electronic device with access to media from the first media provider, a second application corresponding to a second media provider provides the electronic device with access to media from the second media provider, and so on). An integrated media browsing application is an optional application that functions as a centralized media navigation application, displaying representations of media items available from various media applications installed on an electronic device, in order to facilitate easy browsing and viewing of those media items by the user of the electronic device.

[0133] In Figure 6A, the integrated media browsing application displays the integrated media browsing user interface 602, which includes a top menu bar containing the “Next,” “Library,” “Store,” and “Search” elements. Selecting different elements within the top menu bar is optional, causing the integrated media browsing application to display the user interface corresponding to the selected menu element. In Figure 6A, the “Next” menu element is selected, as indicated by the dashed border. Thus, as described herein, the integrated media browsing application displays the user interface 602. In some embodiments, the electronic device hides the top menu bar after a menu item has been selected (e.g., after a predetermined time). Further details of other menu elements within the top menu bar are described below with reference to Figures 8A–8GG.

[0134] In Figure 6A, the user interface includes representations 606-1 to 606-6 of media items available from different media providers (e.g., representation 606-1 for media item A available from media provider 3, representation 606-2 for media item B available from media provider 1, etc.). Representations 606 include information that identifies the media item they correspond to (e.g., "item A") and the media provider from which they are available (e.g., "provider 3"). The media items displayed in Figure 6A are, optionally, media items recommended by the electronic device to the user of the electronic device, and are determined by the electronic device to be recommended media items for various reasons, such as previous user actions associated with the media item and / or the user's previous media viewing behavior. For example, the user may have partially viewed some media items to include them in the user interface 602, the user may have favorited some media items to include them in the user interface 602, and the user may have watched previous episodes of a television series so that the current / next episode is included in the user interface 602, etc. Expressions 606-5 and 606-6 optionally correspond to media recommended by a third party (e.g., a media provider) to the user of the electronic device. In Figure 6A, expressions 606-5 and 606-6 are partially displayed in the user interface 602.

[0135] Representation 606 is overlaid on a background containing representative content from the media item corresponding to Representation 606, which currently has focus in the user interface 602. Specifically, in Figure 6A, Representation 606-2, which corresponds to media item B, currently has focus in the user interface 602 (indicated by a dashed box within Representation 606-2). Thus, Representation 606 is overlaid on a background containing representative content from media item B (indicated by 610 in Figure 6A). The representative content is optionally a still image (e.g., a pre-selected cover art associated with media item B, a still image from the current playback position in media item B, etc.) and / or a video corresponding to media item B (e.g., a video preview of media item B, a video loop of the current playback position in media item B, etc.). The background in Figure 6A also includes information 612 corresponding to media item B, since Representation 606-2, which corresponds to media item B, currently has focus. Information 612 includes an indication of the title of media item B, an indication of the media provider (media provider 1) from which media item B is available, an indication of the reason why media item B is included as a recommended media item in user interface 602 (media item B was purchased by the user), and, if any, an indication (progress bar in Figure 6A) of how many times media item B the electronic device has already played (e.g., how many times media item B the user has already viewed). In Figure 6A, since media item B is partially viewed, representation 606-2 also includes an indication (e.g., a progress bar) of how much media item B the electronic device has already played. In some embodiments, progress indications included in representation are included in representation only when representation has current focus (e.g., if representation 606-2 loses current focus, the electronic device optionally stops displaying the progress indicator in representation 606-2).

[0136] When a different representation 606 within the user interface 602 gains current focus, the background of the user interface 602 changes accordingly. Moving the current focus indicator within the user interface 602 (for example, from one representation 606 to another) is achieved via directional input detected on a remote control device, such as a swipe detected on the touch-sensitive surface of the remote control device. The touch-sensitive surface 604 optionally corresponds to such a remote control device (for example, the touch-sensitive surface 604 optionally includes in a multifunction device configured to simulate a dedicated remote control function in controlling an electronic device 500, or the touch-sensitive surface 604 optionally includes in a dedicated remote control device for controlling the electronic device 500). The device containing the touch-sensitive surface 604 optionally corresponds to any one or more of the devices 100 in Figure 1A, device 100 in Figure 2, device 300 in Figure 3, and devices 510 and 511 in Figure 5A.

[0137] In Figures 6B-6D, a left or right swipe of contact 608 is detected on the touch-sensitive surface 604. Accordingly, as shown in Figure 6D, the electronic device moves the current focus from representation 606-2 to representation 606-3, which corresponds to media item C from media provider 2. Therefore, the electronic device replaces the background of the user interface 602 with representative content from media item C and updates information 612 to correspond to media item C (for example, since the user of the electronic device has favorited media item C, this includes the title of media item C, the media provider 2 indication, and an indication that media item C is a recommended media item). Since the user has not started viewing media item C (for example, the electronic device has not started playing media item C), information 612 does not include an indication of how many times the user has already viewed media item C.

[0138] In Figures 6E-6G, a further left and right swipe of contact 608 is detected on the touch-sensitive surface 604. Accordingly, as shown in Figure 6G, the electronic device also moves its current focus from representation 606-3 to representation 606-7, which corresponds to media item G from media provider 3. Therefore, the electronic device also replaces the background of the user interface 602 with representative content from media item G and updates information 612 to correspond to media item G (for example, since the user of the electronic device has rented media item G, this includes the title of media item G, the indication from media provider 3, an indication that media item G is a recommended media item, and an indication of when the user's access to media item G will expire). In Figures 6E-6G, the swipe of contact 608 causes the electronic device to scroll beyond the last representation 606-4 displayed in the user interface 602. As a result, the electronic device scrolls representation 606-7 into the user interface 602 and scrolls representation 606-1 out of the user interface. Thus, Figures 6E to 6G show the horizontal scrolling characteristics of the rows of representation 606 within the user interface 602.

[0139] In Figure 6H, an up-and-down swipe of contact 608 is detected on the touch-sensitive surface 604, causing the current focus to navigate beyond the bottom edge of the user interface 602. Accordingly, the electronic device scrolls the user interface 602 to fully display the representations 606-5 and 606-6 of the recommended media items in the user interface 602, and partially display further representations of the media items of interest (e.g., Best Movies in Figure 6H). As a result of the up-and-down swipe of contact 608 on the touch-sensitive surface 604 in Figure 6H, the electronic device moves the current focus from representation 606-7 to representation 606-6, as shown in Figure 6H. Furthermore, in response to the up-and-down swipe of contact 608, the background of the user interface 602 corresponding to one of the representations 606-2, 606-3, 606-4, and 606-7 scrolls up and out of the user interface 602 according to the amount of downward scrolling achieved by the swipe. Further swiping up or down scrolls the user interface 602 further downwards, so the background of the user interface moves further up and out of the user interface 602. In some embodiments, as the background of the user interface 602 moves further up, it becomes increasingly blurred and / or transparent.

[0140] In Figure 6I, a further up-and-down swipe of contact 608 is detected on the touch-sensitive surface 604, causing the current focus to navigate again beyond the bottom edge of the user interface 602. Accordingly, the electronic device scrolls the user interface 602 to fully display the representations 614-1 to 614-4 of the media item in question (e.g., Best Movies in Figure 6I). As a result of the up-and-down swipe of contact 608 on the touch-sensitive surface 604 in Figure 6I, as shown in Figure 6H, the electronic device moves the current focus from representation 606-6 to representation 614-3, which corresponds to media item K from content provider 3, and further moves the background of the user interface 602 up and off the display. Representation 614 includes an indication of the title of the media item in question (e.g., Item I, Item J, etc.) and an indication of the media provider that provides the media item in question (e.g., Media Provider 1, Media Provider 2, etc.). A trending media item is a media item that has not been selected to be included in the user interface 602 based on the viewing behavior of the user of the electronic device. In this respect, a trending media item is optionally different from the recommended media items that were originally displayed in the user interface 602 before touch input for scrolling beyond the edge of the user interface 602 is detected (for example, as described with respect to Figure 6A). For example, a trending media item is a media item that is popular with other viewers, or a media item selected by a third party (for example, selected by a media provider to be included in the user interface 602 to promote the media item).

[0141] In Figures 6J-6K, a further up-and-down swipe of contact 608 is detected on the touch-sensitive surface 604, causing the current focus to navigate again beyond the bottom edge of the user interface 602. The electronic device then scrolls further through the user interface 602 to make further representations 614-5-614-8 of the media item of interest visible in the user interface 602 (e.g., Best TV Shows in Figure 6K). Furthermore, as shown in Figure 6K, the electronic device moves the current focus from representation 614-3 to representation 614-7, which corresponds to media item O from media provider 2. When further input for scrolling beyond the bottom edge of the user interface 602 is detected on the touch-sensitive surface 604, additional representations of the media item of interest become optionally visible in the user interface 602.

[0142] As mentioned above, media items are optionally presented by the electronic device as recommended media items for various reasons (e.g., the user rented the media item, the user purchased the media item, the user partially viewed the media item, etc.) (for example, as shown in Figure 6A). In some embodiments, a media item is recommended by the electronic device because it is part of a collection of episodic media (e.g., a television series, a miniseries, etc.) and the user of the electronic device has previously viewed a media item in the collection of episodic media (e.g., a previous episode of a television series). For example, in Figure 6L, the electronic device includes representations 606-9 for recommended media item A-2 and 606-10 for recommended media item A-1 in the user interface 602. Media item A-1 is optionally the first episode in collection A of episodic media items, and media item A-2 is optionally the second episode in collection A of episodic media items. As shown in information 612 in Figure 6L, the user purchased and partially viewed media item A-1. As shown in Figure 6L, as a result of the user purchasing and / or viewing media item A-1 (at least partially), the electronic device recommended media item A-2 to the user. Furthermore, the electronic device does so despite the fact that the user viewed media item A-1 through media provider 1, and media item A-2 is available not through media provider 1 but through a different media provider 3. In Figures 6M-6N, a left-right swipe of contact 608 is detected on the touch-sensitive surface 604, which gives current focus to the representation 606-9 corresponding to media item A-2.

[0143] In some embodiments, the electronic device prioritizes the display of the recommended media item representation 606 depending on the time-related characteristics of the recommended media item. For example, in Figure 6N, media item A-2 is a new episode of episode media collection A, and the new episode was just released today (for example, because media item A-2 became available on media provider 3 today, the user of the electronic device is granted the right to watch media item A-2 today). Thus, the electronic device prioritizes the display of representation 606-9, which corresponds to media item A-2 in representation 606. In particular, as shown in Figure 6N, the electronic device places representation 606-9 at the top of the list of recommended media items. As time progresses, the electronic device may optionally lower the priority of the display of representation 606-9 in representation 606. For example, in Figure 6O, seven days have passed since media item A-2 was released or made available to the user of the electronic device. As a result, the electronic device lowers the priority of the display of expression 606-9 in expression 606, and further recedes expression 606-9 in the list of recommended media items. Meanwhile, because media item Z was recently added by the electronic device, for example, at its discretion, to the list of recommended media items, the electronic device prioritizes the display of expression 606-11 over expression 606-9, which corresponds to media item Z. For the purposes of this disclosure, a user is understood to be granted the right to view a media item if the user has a subscription agreement with a media provider that allows viewing of the media item through the media provider, or if the user has purchased, rented, or accesses a playable copy of the media item (for example, through a personal media server containing a copy of the media item, or through a cloud storage account containing a copy of the media item). A user (or electronic device) is granted the right to view a media item as an additional or alternative if the electronic device is associated with an account that has been granted the right to play the media item (for example, if the electronic device is logged into the account).

[0144] As another example of an electronic device prioritizing the display of a recommended media item representation 606 depending on the time-related characteristics of the recommended media item, in some embodiments, the electronic device prioritizes the display of a recommended media item based on the period during which the user's access to the media item is valid (e.g., because the user rented a media item with a rental expiration date, or because the media provider of the media item has stopped providing the media item). For example, in Figure 6P, the electronic device displays representation 606-2, corresponding to media item B, in the second position in the list of recommended media items. Furthermore, as shown in information 612, the user's access to media item B expires in 25 days. In Figure 6Q, time has passed, and the user's access to media item B now expires in 3 days. Since this expiration time is shorter than the time threshold (e.g., 5 days), the electronic device prioritizes the display of representation 606-2 in representation 606 and displays representation 606-2 earlier in the list of recommended media items. As an example scenario, when a user first rents a movie, that movie is given very high priority in the recommended media representation (e.g., placed at the top of the next queue), and its priority is gradually lowered over time (e.g., it moves from the top of the next queue as other items are added based on user behavior regarding other items), but as the end of the rental period for that movie approaches (e.g., the rental expires in three days), the priority of that movie is raised in the recommended media representation (e.g., it moves to the top of the next queue), and the user is warned that the rental period is about to expire (e.g., the movie moves to the top of the next queue without any user activity regarding that movie). By prioritizing the display of representations for specific media items based on time considerations, electronic devices can communicate media item availability to users more efficiently and thus improve the efficiency of communicating such information to users.

[0145] In some embodiments, when a selection input is detected (e.g., on the touch-sensitive surface 604) while a representation of a recommended media item has focus, the electronic device plays the recommended media item. For example, in Figure 6R, a click on the touch-sensitive surface 451 (corresponding to the touch-sensitive surface 604 in the rest of the figures) of the remote 510 is detected while representation 606-2, which corresponds to media item B from media provider 1, has current focus. Accordingly, the electronic device launches the media application corresponding to media provider 1 and plays media item B within that media application, as shown in Figure 6S. In some embodiments, when the electronic device switches from the integrated media browsing application in Figure 6R to the media application corresponding to media provider 1 in Figure 6S, the navigation hierarchy of the media application, rather than the navigation hierarchy of the integrated media browsing application, manages the electronic device's response to the navigation hierarchy change input detected on the remote 510. For example, in Figure 6T, a click on the “Menu” button 516 of the remote 510 is detected, corresponding to a backward navigation input within the currently active navigation hierarchy on the electronic device (e.g., as described with respect to Figure 5B). In response to a click of the "Menu" button 516, the electronic device navigates backward within the media application corresponding to media provider 1 (for example, back to the media application's home menu), rather than navigating back to the integrated media browsing application from which the media application was launched, as shown in Figure 6U. Thus, launching a media application from the integrated media browsing application in the manner described is an optional "deep" link to the media application.In some embodiments, a request to navigate back from a media item currently playing in a media application generates different responses based on how the user initiated playback of the media item (for example, if the user initiated playback of the media item by selecting it within the application, the request to navigate back will cause the device to return to the previous screen within the application; however, if the user initiated playback of the media item from a content aggregation user interface, the request to navigate back will cause the device to return from the content aggregation user interface).

[0146] As explained with respect to Figures 6R-6S, in contrast to the behavior of the electronic device when the recommended media representation 606 is selected, the electronic device does not, at its discretion, immediately begin playing the corresponding media item when the media item representation of topic is similarly selected. For example, in Figure 6V, representations 614-3 corresponding to the media item of topic K have the current focus. In Figure 6W, while representation 614-3 has the current focus, a click on the touch-sensitive surface 604 is detected, and in response, instead of starting playback of media item K, the electronic device displays a standard page corresponding to media item K, which includes, for example, information 618 about media item K (e.g., genre, director, actors, user ratings, content ratings, length, release year, description, etc.) and information identifying media provider 3 (through which media item K is available). The standard page corresponding to media item K also includes a button 616, which, upon selection, causes the electronic device to play media item K in the media application corresponding to media provider 3. The standard page also includes a button 617 for playing a trailer / preview of media item K, a button 619 for browsing and selecting other media providers where media item K is available and for playing media item K, and a button 621 for adding media item K to favorites (for example, displayed together with the recommended media item representation 606 in Figure 6A). Furthermore, the standard page includes selectable representations of media items (e.g., items AA, BB, CC, DD) that are related to media item K (e.g., of the same genre) and selected for navigating to the standard pages of these media items.

[0147] In some embodiments, the electronic device displays a representation of the recommended media items on the user interface 602 even if the media application that makes these recommended media items available is not installed on the electronic device. For example, in Figure 6Y, the electronic device displays representation 606-6 corresponding to media item F as a recommended media item. Media item F is available through media provider 3. However, the media application corresponding to media provider 3 is not installed on the electronic device. Nevertheless, the electronic device displays representation 606-6 so that the user can discover the existence of media item F and have the opportunity to install the media application to view media item F. In some embodiments, representation 606-6 is included based on a previous user action that occurred on a second electronic device different from the electronic device (for example, the user partially viewed each recommended media item on the second electronic device, not on the electronic device). In some embodiments, for example, recommended media items are associated with a user account of a user who is logged into multiple electronic devices (including the current electronic device and a second electronic device), so that user actions on other devices regarding media items cause these media items to appear as recommended media items on the current electronic device.

[0148] In Figure 6Z, a click on the touch-sensitive surface 604 is detected while representation 606-6 has the current focus. Accordingly, since the media application corresponding to media provider 3 is not installed on the electronic device, as shown in Figure 6AA, the electronic device displays prompt 620, which indicates that the media application corresponding to media provider 3 is not installed on the electronic device, and provides a button 622 for installing the media application and a button 624 for canceling the installation of the media application. In Figure 6BB, the selection of button 622 is detected, which installs the media application corresponding to media provider 3 on the electronic device. In Figure 6CC, after the media application corresponding to media provider 3 has been installed on the electronic device, the electronic device displays prompt 621, which indicates that the media application is installed, and provides a button 626 for allowing the media application to provide access to its corresponding media (for example, by providing login credentials to the media application that authenticates the user with media provider 3), and a button 628 for not allowing the media application to provide access to its corresponding media. In Figure 6DD, the selection of button 626 is detected, which authorizes the media application corresponding to media provider 3 to provide access to media from media provider 3. In response to this authorization, the electronic device begins playing media item F without further input from the user, as shown in Figure 6EE. Thus, after installation and signing in or signing up via the media application, the electronic device immediately begins playing media items within the media application, rather than displaying navigation or the initial startup user interface of the media application (such as the media application's home screen).This result simplifies the user experience regarding viewing media items when the installation of a media application is required first. In some embodiments, a user of an electronic device may have a media provider 3 that is pre-authorized to share user-specific information with an integrated media browsing application (for example, through settings in the user's account when logged into the electronic device). In such a situation, upon detecting the selection of representation 606-6 in Figure 6Z, the electronic device, as shown in Figure 6EE, optionally and automatically installs and / or authorizes the media application corresponding to media provider 3 without requiring further user input, and begins playback of media item F.

[0149] Referring again to Figures 6Y and 6Z, selecting one of the representations 606 causes the electronic device to respond differently, optionally, depending on whether the electronic device has information about the user's current playback position in the media corresponding to the selected representation 606, and / or whether the user is granted the right to access the media corresponding to the selected representation 606. Specifically, in some embodiments, representation 606 corresponds to a collection of episode media (e.g., a television series having multiple episodes and / or seasons), rather than a specific episode in a collection of episode media. The user of the electronic device may be granted the right to watch some or all of the episodes in such a collection, or none of them, and the electronic device may or may not have information about which episodes in the collection the user has watched (for example, the user's "current playback position" in the collection of episode media corresponds to the next episode in the collection of episode media that the user has not watched. For example, if the user has watched episodes 1 and 2, episode 3 is optionally the episode at the user's current playback position in the collection of episode media). The different responses of electronic devices to such expressions 606 are summarized in the table below. [Table 1]

[0150] In some embodiments, the electronic device has a private media browsing mode during which the user's media viewing behavior is not tracked and / or media items recommended to the user based on the user's media viewing behavior are not displayed by the integrated media browsing application in the user interface 602. For example, in Figure 6FF, while the private media browsing mode of the electronic device is disabled, the electronic device displays a representation of recommended media items 606 (shown as 630 in Figure 6FF). In Figure 6GG, while the private media browsing mode of the electronic device is disabled, the electronic device starts playing media item X from media provider 3 on the electronic device (for example, in response to a series of inputs detected on the touch-sensitive surface 604 for searching for and playing media item X on the electronic device). After media item X has been played, and while the electronic device's private media browsing mode is disabled, the electronic device redisplays the user interface 602 with the recommended media item representation 606 before playback of media item X is complete (for example, in response to a series of inputs detected on the touch-sensitive surface 604 to open an integrated media browsing application on the electronic device). As shown in Figure 6HH, the electronic device includes the representation 606-20 of media item X in the recommended media item representation 606 because the user has partially viewed media item X. Furthermore, since media item X is the most recent media item added to representation 606 by the electronic device, the representation 606-20 corresponding to media item X appears at the top of the list of recommended media items.

[0151] In Figure 6II, the electronic device's private media browsing mode is enabled (indicated by 630 in Figure 6II). Accordingly, because the electronic device is currently in private media browsing mode, it stops displaying the suggested media item representation 606 in the user interface 602 and instead displays the topic media item representation 614. If, while the electronic device is in private media browsing mode, the user partially plays a media item (e.g., media item W) on the electronic device as shown in Figure 6JJ, then redisplays the user interface 602 as shown in Figure 6KK, and disables private media browsing mode as shown in Figure 6LL, the electronic device will not include media item W as a suggested media item in representation 606 because media item W was played while the electronic device was in private media browsing mode, and the electronic device will not optionally track the user's media viewing behavior while the electronic device is in private media browsing mode.

[0152] Figures 7A–7L are flowcharts illustrating a method 700 for presenting recommended media items (e.g., movies, TV shows, etc.) to a user in an integrated media browsing application, according to some embodiments of the present disclosure. Method 700 is optionally performed on an electronic device such as device 100, device 300, or device 500, as described above with respect to Figures 1A–1B, 2–3, and 5A–5B. Some operations in Method 700 are optionally combined, and / or the order of some operations is optionally changed.

[0153] As described later, Method 700 provides a method for presenting recommended media items to a user in an integrated media browsing application. This method reduces the cognitive burden on the user when interacting with the user interface of the device of this disclosure, thereby creating a more efficient human-machine interface. In the case of battery-powered electronic devices, increasing the efficiency of user interaction with the user interface saves power and extends the battery charging interval.

[0154] In some embodiments, an electronic device (e.g., a set-top box such as device 100, device 300, or device 500) that communicates with a display (e.g., a television such as display 514) and one or more input devices (e.g., a remote control such as remote 510, or a smartphone such as device 511) displays multiple representations of recommended media items available on the electronic device via different media sources (e.g., different media items available via different media providers and / or different media applications on the electronic device) within a user interface on the display (e.g., a media navigation user interface that allows the user of the electronic device to browse media available on the electronic device) as shown in Figure 6A (702). In some embodiments, the representation of a media item optionally includes content from the corresponding media item (e.g., video(s) and / or images(s)), and / or text information about the corresponding media item. In some embodiments, the recommended media items include only media items to which the user of the electronic device has been granted the right to access, for example, because the user has purchased the media item or because of a user subscription agreement with a content provider that provides access to the media item. In some embodiments, multiple representations are displayed as an overlay on a first representative content (e.g., a hero image or video snippet) corresponding to a representation of the first media item of the recommended media item that currently has focus, as shown in Figure 6A (for example, the user of an electronic device optionally focuses on a media item via one or more navigation inputs provided on one or more input devices). The user interface optionally displays the representative content of the currently focused media item as a background behind the representation of the recommended media, as shown in Figure 6A, so that the representative content as background also changes as the media item with focus changes.

[0155] In some embodiments, recommended media items are selected for display in the user interface based on different previous user actions associated with the recommended media items. For example, a user may have partially watched some media items to include them in the user interface, a user may have favorited some media items to include them in the user interface, or a user may have watched previous episodes of a TV series so that the current / next episode is included in the user interface, etc. In some embodiments, the previous user actions associated with the recommended media items occur on the current electronic device, and in some embodiments, the previous user actions associated with the recommended media items occur on a different electronic device (e.g., another electronic device associated with the user where the user is logged in). In some embodiments, the electronic device stops displaying the media items in the recommended media items when it determines that the media item should no longer be recommended for the user to watch. For example, the user may have finished watching the media item, or the media item may no longer be available (e.g., the rental has expired), etc.

[0156] In some embodiments, while displaying multiple representations of a recommended media item in a user interface overlaid on a first representative content, the electronic device receives input via one or more input devices, as shown in Figures 6B-6D, to a request to navigate through the multiple representations of the recommended media item (e.g., to scroll horizontally or vertically through the representations of the recommended media item so that the media item with focus changes) (704). In some embodiments, in response to receiving input to a request to navigate through multiple representations of a media item (706), the electronic device transitions the representation of a second media item of the multiple recommended media items to have focus instead of the first media item with focus (708) (e.g., to scroll through the recommended media items based on a scroll input to change the media item with focus), and replaces the display of the first representative content with the second representative content corresponding to the second media item (710) (e.g., as the media item with focus changes, the background of the user interface also changes to correspond to the newly focused media item). By doing so, electronic devices improve the efficiency of communicating information to the user about which media item has the current focus, and thus improve the interaction between the user and the electronic device.

[0157] In some embodiments, as described with reference to Figures 6A-6D, the first representative content corresponding to the first media item includes a still image corresponding to the first media item (712), and the second representative content corresponding to the second media item includes a still image corresponding to the second media item (714) (e.g., pre-selected cover art corresponding to the first and second media items, a still image corresponding to the beginning of the first and second media items, or a still image corresponding to the current playback position in the first and second media items as partially viewed). In some embodiments, the first representative content corresponding to the first media item includes a video corresponding to the first media item (716), and the second representative content corresponding to the second media item includes a video corresponding to the second media item (718) (e.g., video previews of the first and second media items (e.g., trailers), a video loop of the current playback position in the first and second media items as partially viewed, etc.). By including such representative content in the background of an integrated media browsing user interface, electronic devices improve the efficiency of conveying information about the content of the currently focused media item to the user, and thus improve the interaction between the user and the electronic device.

[0158] In some embodiments, after receiving an input corresponding to a request to navigate multiple representations of a recommended media item, the electronic device receives a second input via one or more input devices, as shown in Figures 6H-6I, that corresponds to a request to further navigate multiple representations of the recommended media item (e.g., to further scroll the representations of the recommended media item horizontally or vertically) (720). In some embodiments, in response to receiving a second input corresponding to a request to further navigate multiple representations of a recommended media item, the electronic device makes visible in the user interface one or more representations of the topical media item available on the electronic device (e.g., media items selected to be included in the user interface, not based on the viewing behavior of the electronic device user) (722). For example, media popular with other viewers or media selected by a third party may be optionally included in the topical media item. In some embodiments, the electronic device displays only the topical media item to which the user of the electronic device has been granted the right to access, for example, because the user has purchased the media item or because of the user's subscription agreement with a content provider that provides access to the media item. In some embodiments, the representation of the media item of interest was not displayed in the user interface before receiving a second input corresponding to a request to further navigate through multiple recommended media items. By allowing the user to scroll through recommended media items to make the media item of interest visible, the electronic device improves the efficiency of conveying information to the user about media items that may be of interest to the user, and thus improves the interaction between the user and the electronic device.

[0159] In some embodiments, a first media item is included in the recommended media items because the user of the electronic device has selected the first media item to be included in the user interface (e.g., explicit selection by the user of the first media item for inclusion in the user interface), as shown in Figure 6D (724). For example, the user favorites the first media item via the standard page of the first media item, the user provides a long press input on the first media item to display a context menu from which the user can add the first media item to the user's favorite media items if it is not on the standard page of the first media item, or the user provides a voice command to the virtual assistant on the electronic device to perform “Add this to favorites” (if it is on the standard page of the first media item) or “Add [media item name] to favorites” (if it is not on the standard page of the first media item). In some embodiments, a second media item is included in the recommended media items based on the user’s previous viewing behavior with respect to media on the electronic device, as shown in Figure 6A (724). For example, a user of an electronic device may be watching a previous episode of a television series, as shown in Figure 6L, and the second media item may be the next episode of the same series, as shown in Figure 6A, and the user may be partially watching the second media item, as shown in Figure 6G, etc., and the user may be renting / purchasing the second media item. By displaying these media items in a centralized user interface, despite the various ways in which users interact with them, the electronic device improves the efficiency of conveying information to the user about media items that may be of interest to the user, and thus improves the interaction between the user and the electronic device.

[0160] In some embodiments, the second media item is part of a collection of episodic media (e.g., a television series, a miniseries, etc.), as shown in Figure 6L (726). In some embodiments, the collection of episodic media includes media items available through a first content provider and a second content provider (728). In some embodiments, the second media item is available through the second content provider but not through the first content provider, as shown in Figure 6L (730). In some embodiments, the second media item is selected to be included in a recommended media item based on the user's viewing behavior regarding media items in a collection of episodic media that are available through the first content provider (but not through the second content provider), as shown in Figure 6L (732). For example, a user of an electronic device may view a previous media item from a collection of episode media on the electronic device via a first media provider (e.g., the user views a previous episode of a television series via a first media application on an electronic device that provides access to media from the first media provider), and because a second media item is not available via the first media provider, the second media item is included in the user interface as being available via a second media provider (e.g., selecting the second media item provides the user with the second media item to be viewed via a second media application on the electronic device, rather than a first media application on the electronic device). Thus, in some embodiments, the electronic device provides the user with easy access to media, even though the media is accessible via different media applications, and thus improves the interaction between the user and the electronic device.

[0161] In some embodiments, if access to each media item in the recommended media items expires within a predetermined period (e.g., 12 hours, 1 day, 3 days, etc.) (e.g., rental expiration date, streaming service availability expiration date, etc.), the electronic device prioritizes the display of each media item's representation in the recommended media items representation (734) based on the upcoming expiration date of access to each media item (e.g., at or near the front of the list of recommended media items in the user interface), as shown in Figure 6Q. In some embodiments, if access to each media item does not expire within a predetermined period, the electronic device does not prioritize the display of each media item's representation, as shown in Figure 6P. For example, each media item is optionally displayed in the list of recommended media items but is not displayed outside the front of the list (e.g., the position of the representation of a second media item in the recommended media items representation is selected based on the next expiration date of access to the second media item).

[0162] In some embodiments, depending on whether each media item in the recommended media items is one that the user of the electronic device has watched (e.g., the user has watched one or more previous episodes of the collection of episode media) and is a new episode in the collection of episode media that the user has not yet watched (e.g., a newly released episode of a television series, a miniseries, etc.), the electronic device prioritizes the display of the representation of each media item in the representation of recommended media items based on the recency of the user's entitlement to access each media item (e.g., at or near the front of the list of recommended media items in the user interface), as shown in Figure 6N (736). If the user has already watched each media item, each media item is not optionally displayed in the priority area of ​​the user interface; for example, if the user has partially watched each media item, each media item is optionally displayed in the list of recommended media items but not outside the front of the list; or if the user has fully watched each media item, each media item is not displayed at all. For example, the position of a second media item in a recommended media item representation is selected based on the recency of the representation, which grants the user the right to access the second media item (for example, because the episode has just been released to a content provider with which the user has an active subscription). By prioritizing the display of a particular media item representation based on time considerations, electronic devices can more efficiently communicate media item availability to the user and thus improve the efficiency of communicating such information to the user.

[0163] In some embodiments, according to a determination (738) that the user of the electronic device has partially viewed a first media item, the first representative content corresponding to the first media item includes a visual indicator of the degree of playback of the first media item, as shown in Figure 6A. In some embodiments, according to a determination (740) that the user of the electronic device has partially viewed a second media item, the second representative content corresponding to the second media item includes a visual indicator of the degree of playback of the second media item (for example, if the user has partially viewed the media item that currently has focus, the background of the user interface includes a progress bar or other indicator showing how much media the user has viewed). If the user has not partially viewed the media item that currently has focus, the background optionally omits such indicators, as shown in Figure 6D. By including such indicators in the background of the user interface, the electronic device can more efficiently convey media item information to the user and thus improve the efficiency of conveying such information to the user.

[0164] In some embodiments, as shown in Figures 6A to 6G, the first representative content corresponding to the first media item includes information indicating why the first media item is included in the recommended media items (742), and the second representative content corresponding to the second media item includes information indicating why the second media item is included in the recommended media items (744) (for example, the background optionally displays information about why the media item with the current focus is included in the recommended content by the electronic device). For example, the background optionally indicates that the user has favorited the media item, that the user has partially watched the media item, or that the user has watched other media related to the media item. For example, for a partially watched media item, the information includes "Continuing" and optionally playback progress information. For a favorited media item, the information includes "Favorite" and optionally total playback time. For a purchased media item, the information includes "Purchased" and optionally total playback time. For rented media items, the information includes "Rented" and optionally, total playback time, time remaining until the rental expires (e.g., expires in 20 days), and / or playback progress information. For purchased media items, the information includes "Purchased" and optionally, total playback time. For media items corresponding to the next episode in an episodic media collection, the information includes "Next Episode" and optionally, an indication of the media item's position in the episodic media collection (e.g., Season 5, Episode 2). For media items corresponding to a newly available episode in an episodic media collection, the information includes "New Episode" and optionally, an indication of the media item's position in the episodic media collection (e.g., Season 5, Episode 2). For media items corresponding to media items being removed from the subscription service, the information includes "Expiring Soon" and optionally, an indication of when the media item will be removed from the subscription service (available until October 30).In the case of a media item corresponding to the next episode of a collection of episodic media that is not available to the user without purchase or subscription, the information includes "next episode" and an indication that the user is not granted the right to play the media item (e.g., purchase or subscribe). By including such information in the background of the user interface, the electronic device can more efficiently convey the media item information to the user, thus improving the efficiency of conveying such information to the user.

[0165] In some embodiments, as shown in FIGS. 6A - 6G, the first representative content corresponding to the first media item includes information indicating the source of the first media item (746), and the second representative content corresponding to the second media item includes information indicating the source of the second media item (748) (e.g., the background optionally displays information about the source of the media item having the current focus). For example, the background optionally includes the logo of the TV channel where the media item is available, the icon of the media application where the media item is available, etc. By including such information in the background of the user interface, the electronic device can more efficiently convey the media item information to the user, thus improving the efficiency of conveying such information to the user.

[0166] In some embodiments, the electronic device receives input via one or more input devices corresponding to the selection of each representation of each media item of the recommended media item (e.g., a click of a button on the input device when each representation has focus) (750), as shown in Figure 6R. In some embodiments, in response to receiving input corresponding to the selection of each representation of each media item (752), the electronic device launches a media application on the electronic device corresponding to each media item (e.g., a different application from the application on which the media item is displayed, or the same application as the application on which the media item is displayed) (754), as shown in Figure 6S. In some embodiments, the electronic device plays each media item on the display within the media application corresponding to each media item (756), as shown in Figure 6S.

[0167] In some embodiments, an input corresponding to a request to navigate multiple recommended media items corresponds to a request to navigate multiple recommended media items in a first direction, as shown in Figures 6B–6D (758) (e.g., the input includes a horizontal right / left scroll input). In some embodiments, the electronic device receives a second input via one or more input devices, as shown in Figures 6H–6I, corresponding to a request to further navigate multiple recommended media items in a second direction different from the first direction (760) (e.g., the second input includes a vertical up / down scroll input). In some embodiments, in response to receiving a second input corresponding to a request to further navigate multiple recommended media items, the electronic device makes visible in the user interface one or more representations of additional recommended media items available on the electronic device, as shown in Figures 6H–6I (762), where the representations of the additional recommended media items (e.g., items not in the “next” queue) were not displayed in the user interface before receiving the second input (e.g., the additional recommended media items are displayed when scrolling beyond the original recommended media items). In some examples, additional recommended media items are not selected based on previous user actions associated with these media items. In some embodiments, additional recommended media items include trending media items (media items popular with other audiences), media items selected for advertising by content providers or other third parties, etc. In some embodiments, the electronic device receives input (e.g., a click of a button on the input device when each of the additional recommended media items has focus) via one or more input devices, as shown in Figure 6W (764).In some embodiments, in response to receiving an input corresponding to the selection of a second respective representation of each second media item, the electronic device displays, as shown in FIG. 6X, on the display, a media information page corresponding to each second media item (e.g., a user interface that is optionally a dedicated standard page for each second media item) (766). For example, a standard page that includes information about each second media item and selectable affordances to play each second media item on the electronic device when selected.

[0168] In some embodiments, while a media application corresponding to each media item is displayed on the display, the electronic device, as shown in FIG. 6T, receives, via one or more input devices, an input corresponding to a request to navigate backward on the electronic device (e.g., selection of button 516 on remote 510, an input corresponding to moving backward in a navigation hierarchy, etc.) (768). In some embodiments, in response to receiving an input corresponding to a request to navigate backward on the electronic device, the electronic device, as shown in FIG. 6U, navigates backward within the media application according to the input (770) (e.g., the link to the media application is a "deep" link, whereby when the user enters the media application to play each media item, the navigation hierarchy of the media application manages the electronic device's response to the navigation input detected by the input device). However, in some embodiments, the backward navigation input received here within the media application navigates back to the user interface where the recommended media item representation is displayed rather than navigating backward within the media application.

[0169] In some embodiments, each recommended media item is included in the recommended media items based on previous user actions that occurred on a second electronic device different from the electronic device (for example, the user partially viewed each recommended media item on the second electronic device, not on the electronic device) (772), as shown in Figure 6Y. In some embodiments, for example, the recommended media items are associated with a user account of a user who is logged into multiple electronic devices (including the current electronic device and the second electronic device), so that user actions on other devices regarding media items cause these media items to appear as recommended media items on the current electronic device. In some embodiments, as shown in Figure 6Y, the media application on which each recommended media item is available is not installed on the electronic device (774) (for example, each recommended media item will appear as a recommended media item on the electronic device even if the media application for viewing each recommended media item is not installed on the electronic device). In some embodiments, the respective media application on which each recommended media item is available is installed on the second electronic device. Displaying each recommended media item allows users to discover the existence of each recommended media item, gives them the opportunity to install media applications to view each recommended media item, and thus improves the user's interaction with electronic devices.

[0170] In some embodiments, the electronic device receives input via one or more input devices corresponding to the selection of each representation of each recommended media item (e.g., a click of a button on the input device when each representation has focus) (776), as shown in Figure 6Z. In some embodiments, in response to receiving input corresponding to the selection of each representation of each recommended media item, the electronic device displays a prompt on the display for installing the respective media application on the electronic device, as shown in Figure 6AA (e.g., since the media application for viewing each media item is not installed on the electronic device, selecting each media item for playback prompts the user to install the media application for viewing each media item).

[0171] In some embodiments, the electronic device receives a series of inputs corresponding to inputs for installing and authorizing each media application on the electronic device via one or more input devices, as shown in Figures 6BB-6DD (778) (for example, the user installs and signs in to the media application or signs up for services provided by the media application). In some embodiments, once each media application is installed and authorized on the electronic device without further user intervention, the electronic device begins playing each media item on the display, as shown in Figure 6EE (780) (for example, after installation and signing in or signing up via the media application, the electronic device immediately begins playing the media item in the media application rather than displaying navigation or the initial startup user interface of the media application (such as the home screen of the media application)). Thus, no further user action is optionally required after the installation and authorization of each media application before each media item is played on the electronic device. This results in a simplified user experience regarding viewing media items when the installation of the media application is initially required, and thus improves the interaction between the user and the electronic device.

[0172] In some embodiments, the electronic device receives input via one or more input devices, as shown in Figure 6GG, corresponding to a first action with respect to each media item not included in the recommended media items (782) (for example, the user partially watches each media item, the user favorites each media item, etc.). In some embodiments, after receiving input corresponding to a first action with respect to each media item, the electronic device displays on the display a user interface containing multiple representations of the recommended media items (for example, the user redisplays the media navigation user interface of a media browsing application after taking a first action with respect to each media item), as shown in Figure 6HH (784).

[0173] In some embodiments, while displaying a user interface on a display, the electronic device receives input via one or more input devices to enable private media browsing mode on the electronic device (e.g., selection of a private browsing mode toggle in the settings of a media browsing application) (786), as shown in Figure 6II. In some embodiments, in response to receiving input to enable private media browsing mode on the electronic device (788), the electronic device enables private media browsing mode on the electronic device (790) and replaces multiple representations of recommended media items in the user interface with a second set of multiple representations of second recommended media items that have not been selected to be included in the user interface based on previous user actions associated with these media items (792), as shown in Figure 6II. For example, in private media browsing mode, the electronic device does not optionally provide the user with recommended media items that are selected based on the user's media viewing behavior and / or specific to the user. Instead, in some embodiments, the electronic device provides recommended media items that are popular with other viewers (e.g., trending media items) or media items selected by a third party, as shown in Figure 6II.

[0174] In some embodiments, while private media browsing mode is enabled on the electronic device, the electronic device receives a second input via one or more input devices, as shown in Figure 6JJ, corresponding to a first action regarding each second media item not included in the recommended media items (794) (for example, the user partially watches each second media item, the user favorites each second media item, etc.). In some embodiments, after receiving the second input, the electronic device receives an input via one or more input devices, as shown in Figure 6LL, to disable private media browsing mode on the electronic device (796). In some embodiments, upon receiving input to disable private media browsing mode on the electronic device (798), the electronic device disables private media browsing mode on the electronic device (798-2), as shown in Figure 6LL, and redisplays multiple representations of the recommended media items in the user interface, each representation of the recommended media items not including the representation of each of the second media items (798-4) (for example, the electronic device optionally does not track the user's media viewing actions when the electronic device is in private media browsing mode). For example, even if the user performs an action on each of the second media items to include each of the second media items in the recommended media items within the media browsing application, the electronic device does not include each of the second media items in the recommended media items because the user performed the action while the electronic device was in private media browsing mode.

[0175] In some embodiments, while private media browsing mode is enabled on the electronic device, the electronic device receives input via one or more input devices to disable private media browsing mode on the electronic device (e.g., deselecting the private browsing mode toggle in the settings of a media browsing application) as shown in Figure 6LL (798-6). In some embodiments, in response to receiving input to disable private media browsing mode on the electronic device (798-8), the electronic device disables private media browsing mode on the electronic device (798-10) as shown in Figure 6LL and redisplays multiple representations of recommended media items in the user interface (798-12) (e.g., if private media browsing mode is disabled, the electronic device optionally reverts to displaying recommended media items to the user that are selected based on the user's media viewing behavior and / or specific to the user). Such private media browsing functionality of the electronic device, when not desired, allows the user to browse and view media items on the electronic device without the electronic device tracking such behavior, thus improving the interaction between the user and the electronic device.

[0176] It should be understood that the specific order in which the operations are described in Figures 7A-7L is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various methods for rearranging the operations described herein. Furthermore, it should be noted that the details of other processes described herein (e.g., methods 900, 1100, 1300, and 1900) are also applicable to other methods described herein, as are the details of method 700 described above with respect to Figures 7A-7L. For example, the integrated media browsing application and user interface, recommended media items, topical media items, media applications, representations of recommended and topical media items, and media providers described above with respect to method 700 may optionally have one or more of the characteristics of the integrated media browsing application and user interface, recommended media items, topical media items, media applications, representations of recommended and topical media items, and media providers described above with respect to other methods described herein (e.g., methods 900, 1100, 1300, and 1900). For the sake of brevity, these details will not be repeated here.

[0177] The operations in the above-described information processing method are optionally performed by executing one or more functional modules in an information processing device such as a general-purpose processor (for example, as described with respect to Figures 1A, 3, 5A, and 14) or an application-specific chip. Furthermore, the operations described above with respect to Figures 7A to 7L are optionally performed by the components shown in Figures 1A to 1B. For example, the display operation 702, the reception operation 704, the transition operation 708, and the replacement operation 710 are optionally performed by the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 in the event sorter 170 detects contacts on the touch-sensing surface 604, and the event dispatcher module 174 transmits the event information to application 136-1. Each event recognition unit 180 in application 136-1 compares the event information with its respective event definition 186 and determines whether the first contact at the first position on the touch-sensing surface corresponds to a predetermined event or sub-event (such as the selection of an object on the user interface). When each predetermined event or sub-event is detected, the event recognition unit 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls the data updater 176 or object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes can be carried out based on the components shown in Figures 1A-1B. Category-based media browsing

[0178] Users interact with electronic devices in many different ways, including interacting with media (e.g., music, movies, etc.) available (e.g., storeable or accessible) on the electronic device (as described with reference to, for example, Figures 6A-6LL, 8A-8GG, 10A-10Z, 12A-12V and / or Figures 18A-18J). For example, a user can browse and play media accessible on the electronic device. A user may also request to browse such media by category (e.g., movies, television programs, etc.). Embodiments described below provide ways in which an electronic device facilitates browsing of media items by category, thereby improving user interaction with the electronic device. Improving interaction with the device reduces the time required by the user to perform an action, subsequently reducing the power consumption of the device and increasing the battery life of a battery-powered device. It is understood that people use devices. When a person uses a device, that person is optionally called a user of the device.

[0179] Figures 8A–8GG illustrate exemplary ways in which an electronic device facilitates browsing of media items by category according to some embodiments of the present disclosure. These embodiments in the drawings are used to illustrate processes described later, including processes described with reference to Figures 9A–9H.

[0180] Figure 8A shows an exemplary display 514. The display 514 optionally displays one or more user interfaces containing various content. In the example shown in Figure 8A, the display 514 displays an integrated media browsing application (e.g., the integrated media browsing application described with reference to Figures 6A-6LL) running on an electronic device (e.g., electronic device 500 in Figure 5A), and the display 514 is either part of the electronic device or connected to it. In Figure 8A, the integrated media browsing application displays an integrated media browsing user interface 802 for browsing various media accessible on the electronic device. The user interface 802 includes selectable user interface elements 804-1 to 804-4 in the top menu bar for navigating the integrated media browsing application, which will be described in more detail later. Furthermore, as described with reference to Figures 6A-6LL, in some embodiments, the electronic device terminates the display of the top menu bar after one of the user interface elements 804 has been selected (e.g., within a predetermined time thereafter). In Figure 8A, user interface element 804-1, which corresponds to the recommended media item, is currently selected (indicated by a dashed border), and the electronic device displays the recommended media item representations 806-1 to 806-6 and the topic media item representations 815-1 to 815-4 (for example, the recommended and topic media items described with reference to Figures 6A to 6LL), with representation 815-3, which corresponds to media item K, having the current focus (indicated by a dashed box within representation 815-3). In Figure 8A, the recommended media item representation 806 and the topic media item representation 815 are displayed in rows.In some embodiments, the electronic device displays only representations 806 and 815 of media items to which the user of the electronic device has been granted the right to access (e.g., the user has a subscription agreement with a media provider that grants the user access to the media item, or the user has purchased the media item), and does not display representations of media items to which the user of the electronic device has not been granted the right to access.

[0181] In some embodiments, when a representation of the media item of interest in Figure 8A is selected, the electronic device displays a standard page corresponding to that media item of interest. For example, in Figure 8B, a click on the touch-sensitive surface 604 is detected while the representation 815-3 corresponding to media item K has the current focus. Accordingly, the electronic device displays a standard page corresponding to media item K, as shown in Figure 8C, which includes various information and user interface objects as described with reference to Figure 6X. The standard page corresponding to media item K further includes a button 808, which, when selected, causes the electronic device to play media item K, as shown in Figures 8C-8D.

[0182] In some embodiments, a user of an electronic device can scroll through representations 815 of media items of interest and reveal user interface elements within the user interface 802 that allow browsing media items by category. For example, in Figures 8E-8H, a top-to-bottom swipe of the contact 608 is detected on the touch-sensitive surface 604. In response, the electronic device scrolls through representations 815 of media items of interest and reveals additional media items of interest (e.g., best TV shows) on the user interface 802, thereby revealing user interface elements 812-1-812-4 corresponding to recommended media categories available on the electronic device. For example, user interface elements 812 include user interface element 812-1 for movies, user interface element 812-2 for television programs, user interface element 812-3 for news programs, and user interface element 812-4 for sports programs. As shown in Figure 8H, the user interface elements 812 corresponding to media categories are displayed in a row, similar to how the representations 806 of recommended media items are displayed.

[0183] When one of the user interface elements 812 is selected, the electronic device displays media items accessible by the electronic device in the selected category. For example, in Figure 8I, a click on the touch-sensitive surface 604 is detected while the user interface element 812-1 corresponding to movies has the current focus. Accordingly, the electronic device replaces the display of the media item representations 814-1 to 814-12 within the movie category and the representation 815 of the topic media item and the media category user interface element 812, as shown in Figure 8J. In some embodiments, the media item representation 814 within the movie category is displayed in the same spatial arrangement as the topic media item representation 815 and / or the media category user interface element 812 (e.g., in a row). In addition, the media item for which representation 814 is displayed in Figure 8J is optional, and unlike the media items for which representations 806 and / or 815 are displayed in Figures 8E to 8G, the same media item is not displayed multiple times when the user browses media within the integrated media browsing application. As shown in Figure 8J, in some embodiments, the film media items 814 are displayed in groups based on one or more common characteristics (e.g., awards, popularity, critical acclaim, etc.).

[0184] As explained with reference to Figures 8E-8H, the user can scroll through the representations 814 of media items within the selected category, revealing user interface elements within the user interface 802 that allow browsing media items for each subcategory of the selected category. For example, in Figures 8K-8L, a top-to-bottom swipe of the contact 608 is detected on the touch-sensitive surface 604. In response, the electronic device scrolls through the representations 814 of media items within the movie category, revealing user interface elements 816-1 to 816-4 within the user interface 802 that correspond to the subcategories of movie media available on the electronic device. For example, user interface element 816 includes user interface element 816-1 for drama, user interface element 816-2 for comedy, user interface element 816-3 for suspense film, and user interface element 816-4 for action film. As shown in Figure 8L, the user interface element 816 corresponding to the media subcategory is displayed on a row, similar to how the representation of recommended media items 806, the representation of trending media items 815, and the representation of movie media items 814 are displayed. In addition, as described above, when one of the user interface elements 816 is selected, the electronic device displays the media items accessible by the electronic device in the selected subcategory (for example, as described with reference to Figures 8I-8J).

[0185] In some embodiments, the user can scroll between the recommended media item representation 806, the topic media item representation 815, and the user interface element 812 for browsing media items by category, revealing additional representations of recommended media items within the user interface 802, which are grouped together by category (e.g., different categories from those represented by the user interface element 812). For example, in Figures 8M-8P, a top-to-bottom swipe of the contact 608 is detected on the touch-sensitive surface 604. In response, the electronic device can scroll between the media item representation 806, the topic media item representation 815, and the user interface element 812, revealing the topic media item representations 818-1-818-4 of music videos recommended to the user within the user interface 802. As shown in Figure 8P, the representation 818 corresponding to the music video media item is displayed in a row, similar to how the recommended media item representation 806, the topic media item representation 815, and the user interface element 812 corresponding to the media category are displayed. In addition, as described above, when one of the user interface elements 818 is selected, the electronic device displays a standard page corresponding to the selected media item (for example, as described with reference to Figures 8B-8C). In Figure 8Q, an additional top-to-bottom swipe of contact 608 is detected on the touch-sensitive surface 604, revealing additional topical media items, which are located in the documentary category of media items, as described above. Additional topical media items can be optionally accessed by further scrolling of the user interface 802.

[0186] As described above, in some situations, the electronic device displays a media category user interface element 812 for a given media category, through which the user can browse media items within that media category (e.g., user interface element 812-1 for browsing movies), while in other situations, the electronic device does not display a media category user interface element 812 for a given media category (e.g., rather, the electronic device displays a representation of the media items in a given media category as a row within the user interface 802, and does not first require the user to select a media category user interface element 812 to browse media items within that category (e.g., representations 818 for music video and documentary media items in Figures 8P-8Q)). In some embodiments, if there are enough (e.g., more than 3, 5, or 10) recommended media items in that media category, the electronic device displays a media category user interface element 812 for the given media category; otherwise, the electronic device directly displays a representation of those media items within the user interface 802, without grouping those recommended media items behind the corresponding user interface element 812. For example, in Figure 8R, three media items are included in the sports media category. Since three media items is less than the threshold number of media items required to generate the user interface element 812 for the sports category (e.g., five media items), the electronic device does not display the sports user interface element 812. Instead, as shown in Figure 8R, it displays representations of the sports media items 818-9 to 818-11 in a row within the user interface 802. However, if the sports category includes five recommended media items, as shown in Figure 8S, the electronic device displays the user interface element 812-4 corresponding to the sports category, as shown in Figure 8T, and does not display representations of the sports media items in a row within the user interface 802.

[0187] In some embodiments, the electronic device has a function of implementing media restrictions (e.g., set by a user) and restricts access to media having a predetermined content designation (e.g., R designation, PG-13 designation, etc.). When such media restrictions are in effect, the electronic device optionally omits media items restricted by the media restrictions from its recommended and / or trending media items. For example, in FIG. 8U, the media restrictions are not in effect (shown by 820), and the electronic device displays a representation 815 of a trending media item on the user interface 802. In FIG. 8V, the media restrictions are implemented, restricting user access to media designated PG-13 or lower (shown by 820). As a result, the electronic device no longer displays the representations 815-2 and 815-5 of the recommended media items corresponding to the media items having an R designation on the user interface 802.

[0188] In Figure 8W, input is detected to select user interface element 804-2 corresponding to the media library. As a result, the electronic device displays representations 822-1 to 822-8 of media items in the media library on the user interface 802. The media library optionally includes media items that the user of the electronic device has chosen to include in the media library, for example, by purchasing, renting, or liking the media items, as shown in Figure 8W. The media library optionally includes media items from collections different from the recommended media items in Figure 8A, because the media items included in the media library are optionally included due to explicit user actions on those media items, while the recommended media items may or may not be included in the recommended media items due to explicit user actions on those media items, as already explained. When user interface element 804-2 of the media library is selected, user interface 802 further includes selectable affordances 824 for sorting media items in the media library based on various characteristics such as title, date the item was added to the media library, type of media item (e.g., movie, TV show, etc.), and content designation.

[0189] In Figure 8X, input is detected to select user interface element 804-3, which corresponds to a media application that is not installed on the electronic device and provides access to media on the electronic device. As a result, the electronic device displays representations 826-1 to 826-4 of media applications that are not installed on the electronic device. For example, media application A, which provides access to media from media provider 1, is not installed on the electronic device, and therefore, when store user interface element 804-3 is selected, the electronic device displays representation 826-1, which corresponds to media application A providing access to media from media provider 1, on the user interface 802. The electronic device similarly displays representations 826-2 to 826-4 of media applications that are not installed on the electronic device. As shown by 828, the user of the electronic device is granted the right to access media through media providers 1, 3, and 4. Therefore, some representations 826 correspond to media applications to which the user is granted the right to access media (e.g., media applications A and C), and some representations 826 correspond to media applications to which the user is not granted the right to access media (e.g., media applications B-1 and B-2).

[0190] The electronic device further displays representations 830-1 and 830-2 corresponding to media subscription agreements available to the user of the electronic device. For example, representation 830-1 corresponds to a media subscription agreement to media provider 4, and representation 830-2 corresponds to a media subscription agreement to media provider 5. Each representation 830 includes a visual representation (e.g., images, videos) of the media for which the corresponding subscription agreement will be available to the user of the electronic device (e.g., visual representations D-1 and D-2 in representation 830-1, and visual representations E-1 and E-2 in representation 830-2). These visual representations are optionally pre-selected cover art or images for the media within those subscription agreements, and / or video previews of the media within those subscription agreements. Thus, the electronic device provides information that is easily verifiable by the user regarding the media for which the user can gain access. Representation 826 is selectable for installing the corresponding media application on the electronic device, and representation 830 is selectable for subscribing to the corresponding media subscription agreement on the electronic device.

[0191] In some embodiments, the electronic device does not display representations of applications to which the user of the electronic device has already been granted the right to access media (due to a subscription agreement with a media provider corresponding to those applications), even if those media applications are not installed on the electronic device. For example, in Figure 8Y, the user has been granted the right to access media through media providers 1, 3, and 4. As a result, the electronic device does not display representations 826-1 and 826-4 corresponding to applications of media providers to which the user has already been granted the right to access, nor does it display representation 830-1 corresponding to a media subscription agreement with media provider 4 that the user already has.

[0192] In some embodiments, media from a given media provider may be accessible through multiple media applications. For example, in Figure 8Y, both media applications B-1 and B-2 can provide access to media from media provider 2. For example, media provider 2 may have a first application that provides access to its media based on the user's subscription agreement with a cable television company (e.g., an indirect subscription agreement to media provider 2 through the user's subscription agreement with a cable television company or other similar company that has an arrangement to provide media from media provider 2 to its customers), and a second application that provides access to its media based on the user's direct subscription agreement with media provider 2. In such a situation, once the user installs either media application B-1 or B-2, the electronic device optionally terminates the display of the other representation of the media application within the user interface 802. For example, in Figure 8Z, a click on the touch-sensitive surface 604 is detected while the representation 826-2 corresponding to media application B-1 has the current focus. Accordingly, the electronic device downloads and / or installs media application B-1, terminates the display of representation 826-2 and representation 826-3, which corresponds to media application B-2 as shown in Figure 8AA.

[0193] In Figure 8BB, input is detected to select user interface element 804-4 for searching media accessible by the electronic device. As a result, the electronic device displays the search interface on display 514. The search interface includes a search field 836 that provides search criteria and displays representations 834-1 to 834-4 of media items obtained from the search. As shown by 828, the user is granted the right to access media from media providers 1, 3, and 4. Furthermore, the search interface includes a user-configurable option to search for all media accessible by the electronic device, or only media accessible by the electronic device to which the user of the electronic device is granted the right to access. In Figure 8BB, the search is not limited to media to which the user of the electronic device is granted the right to access (as shown by 832). As a result, depending on the search criterion "comedy" entered in search field 836, the electronic device displays search result representations of media items accessible via media providers 1, 2, and 3, even if the user is not granted the right to access media via media provider 2.

[0194] However, in some embodiments, the electronic device searches for media items to which the user has been granted access rights, and does not search for media items to which the user has not been granted access rights. For example, in Figure 8CC, the search is limited to media to which the user of the electronic device has been granted access rights (indicated by 832). As a result, depending on the “comedy” search criterion entered in the search field 836, the electronic device displays only expressions 834-1 and 834-3 corresponding to media items from media providers 1 and 3, but not expressions 834-2 and 834-4 corresponding to media items from media provider 2.

[0195] In some embodiments, when an electronic device is performing a search for media items, media restrictions may be in place that limit media playback based on content designations. For example, in Figure 8DD, media restrictions are in place (indicated by 820) that limit media playback to media with designations of PG-13 or lower. However, in some embodiments, the electronic device performs the search and displays the resulting representations 834 regardless of the media restrictions in place. For example, in Figure 8DD, even though those representations correspond to media items with R designations, the electronic device displays the resulting representations 834-1 and 834-4. However, selecting those representations does not play those media items, while selecting search result representations corresponding to media items permitted by media restrictions will play those media items. For example, in Figure 8EE, a click on the touch-sensitive surface 604 is detected while representation 834-1, which corresponds to media item A with an R designation, has the current focus. In response, instead of playing media item A, the electronic device displays a visual indication that media item A is restricted by media restrictions, as shown in Figure 8FF. In some embodiments, if the search is restricted to licensed media (as shown by 832 in Figure 8GG), the electronic device will not display search result representations of media that the user of the electronic device is not licensed to view, as shown in Figure 8GG.

[0196] Figures 9A–9I are flowcharts illustrating a method 900 that facilitates browsing of media items by category, according to some embodiments of the present disclosure. The method 900 is optionally performed on an electronic device such as device 100, device 300, or device 500, as described above with reference to Figures 1A–1B, 2–3, and 5A–5B. Some operations within the method 900 are optionally combined, and / or the order of some operations is optionally changed.

[0197] As described below, Method 900 provides a method for facilitating browsing of media items by category. The method reduces the cognitive burden on the user when interacting with the user interface of the device of this disclosure and generates a more efficient human-machine interface. In the case of battery-operated electronic devices, increasing the efficiency of user interaction with the user interface saves power and increases the time between battery charges.

[0198] In some embodiments, an electronic device (e.g., a set-top box such as device 100, device 300, or device 500) that communicates with a display (e.g., a television such as display 514) and one or more input devices (e.g., a remote control such as remote 510, or a smartphone such as device 511) receives, via one or more input devices, a request to display recommended media items on the display for the user of the electronic device (e.g., a request to launch and display an integrated media browsing application on the electronic device and display media available on the electronic device from different media providers and / or different media applications, such as those described in method 700) (902). In some embodiments, the media displayed by the electronic device is media that the electronic device has determined to be of interest to the user based on the user's previous media viewing actions. In some embodiments, upon receiving a request to display recommended media items, the electronic device displays a first set of representations of the recommended media items (e.g., a representation of each media item of the recommended media) within a media navigation user interface on the display (e.g., within a media browsing application running on the electronic device, which corresponds to a media provider and is separate from the application on the electronic device that provides media from those content providers) as shown in Figure 8A, etc. (904). In some embodiments, the representations include images and / or videos from the recommended media and / or text information about the recommended media. In some embodiments, the representations are displayed in rows on the media navigation user interface. In some embodiments, the representations are selectable to play the corresponding media item and / or display additional information about the corresponding media item, as shown in Figures 8B-8D, etc.

[0199] In some embodiments, while displaying a first plurality of representations of a recommended media item, the electronic device receives navigation input via one or more input devices, as shown in Figures 8E-8H, etc., that corresponds to a request to scroll between the first plurality of representations of the recommended media item (e.g., a swipe input detected on the touch-sensitive surface of one or more input devices, which moves the current focus from one representation to another according to the magnitude and / or direction of the swipe input) (906). In some embodiments, in response to the reception of navigation input, the electronic device scrolls between the first plurality of representations of the recommended media item (908), revealing a plurality of media category user interface elements corresponding to the media categories of the recommended media in the media navigation user interface, while the plurality of representations of the media item are displayed before the navigation input is received, and the media category user interface elements (e.g., a user interface element corresponding to a TV program, a user interface element corresponding to a movie, a user interface element corresponding to kids' content, a user interface element corresponding to an editorial collection of content, etc.) are not displayed. In some embodiments, user interface elements corresponding to media categories are displayed in the same spatial layout of the media navigation user interface as representations of recommended media (e.g., visual blocks within a row of visual blocks).

[0200] In some embodiments, while displaying media category user interface elements, the electronic device receives input via one or more input devices to select each of the multiple media category user interface elements (e.g., a click or tap detected on the touch-sensitive surface of one or more input devices while each user interface element is currently selected) (910), and each media category user interface element corresponds to each media category of the media category. In some embodiments, in response to receiving input to select each user interface element, the electronic device replaces the media category user interface elements with a media navigation user interface (912) (e.g., when a user selects media in a particular category, the media navigation user interface is updated to display a representation of the media corresponding to the selected media category). In some embodiments, the representation of the media item corresponding to the selected media category is displayed in the same spatial layout of the media navigation user interface as the representation corresponding to the recommended media and / or media category (e.g., a visual block in a row of visual blocks). In some embodiments, each media category is a media filter, and the recommended media items suitable for display within a second set of recommended media items are a subset of the recommended media items suitable for display within the first set of recommended media items. In this way, the electronic device facilitates the ability for the user to easily browse and discover media by category, improving the efficiency of the interaction between the user and the electronic device.In some embodiments, recommended media items within each media category are not included in the recommended media items (918) (for example, media items displayed when a content category is selected are optionally not displayed in the original media navigation user interface before a content category is selected). Thus, when a user of an electronic device browses media in the media navigation user interface, they are not required to confirm a given media item twice, improving the efficiency of user-electronic device interaction.

[0201] While displaying media category user interface elements, the electronic device optionally receives a second navigation input (e.g., a swipe input detected on the touch-sensitive surface of one or more input devices) via one or more input devices, as shown in Figures 8O-8Q, etc., that corresponds to a request to scroll through the media category user interface elements (914). In response to the receipt of the second navigation input, the electronic device optionally scrolls between media category user interface elements (916), and as shown in Figures 8O-8Q, etc., reveals a third or more representations of recommended media items different from the first and second or more recommended media items in the media navigation user interface (e.g., additional recommended media items are optionally displayed in the media navigation user interface below the media category user interface elements and / or to the left or right of the media category user interface elements). In this way, the electronic device facilitates the ability for the user to easily browse and discover additional media by category, improving the efficiency of user-electronic device interaction.

[0202] In some embodiments, according to the determination that a given media category of recommended media contains more than a threshold number of media items (e.g., 5, 10, or 15), the media category user interface element corresponding to the given media category is included in multiple media category user interface elements, and the representation of media items included in the given media category of recommended media is not displayed within the media navigation user interface, as shown in Figures 8S to 8T, etc. (920) (for example, if a category has enough media items associated with it, it is shown as a category user interface element, and the media items within that category are optionally displayed only after the user selects that category user interface element). In some embodiments, according to the determination that a given media category of recommended media contains fewer than a threshold number of media items (e.g., 5, 10, or 15), the media category user interface element corresponding to the given media category is not included in multiple media category user interface elements, and the representation of media items included in the given media category of recommended media is displayed within the media navigation user interface, as shown in Figure 8R, etc. (922) (for example, if a category does not have enough media items associated with it, it is not shown as a category user interface element, and the media items within that category are optionally displayed within the media navigation user interface, allowing the user to browse those media items). In this way, the electronic device intelligently presents media items to the user to facilitate browsing of those media items, improving the efficiency of interaction between the user and the electronic device.

[0203] In some embodiments, recommended media items include media items to which the user of the electronic device has been granted the right to access the electronic device (e.g., the user has a subscription agreement with a media provider that provides user access to the media item, the user has purchased the media item, etc.), and exclude (e.g., not include) media items to which the user of the electronic device has not been granted the right to access the electronic device (924) (e.g., the electronic device recommends to the user only media to which the user has been granted the right to access).

[0204] The electronic device optionally receives input via one or more input devices, such as in Figure 8B, to select each expression of each media item of a first or second set of expressions of a recommended media item (for example, a click of a button on the input device when each expression has focus) (926). In response to receiving input to select each expression of each media item, the electronic device optionally displays on the display, such as in Figure 8C, a page corresponding to each media item containing information about each media item, and selectable affordances that, when selected, play each media item on the electronic device (for example, a user interface which is optionally a dedicated standard page for each media item) (928). In some embodiments, the electronic device optionally receives selection of a selectable affordance via one or more input devices, such as in Figure 8C (a click of a button on the input device when a selectable affordance has focus) (930). In response to receiving selection of a selectable affordance, the electronic device optionally plays each media item on the display, such as in Figure 8D (932). In this way, electronic devices facilitate understanding of and playback of media items on the electronic device, improving the efficiency of interaction between the user and the electronic device.

[0205] In some embodiments, the first multiple representations of recommended media items include representations of recommended media items displayed in each area (e.g., within a row) of the media navigation user interface corresponding to each media category of recommended media, as shown in Figures 8P to 8Q, etc. (934) (for example, the representations of recommended media are displayed in rows corresponding to the categories of recommended media, such as Best Movies, Best TV Shows, Genres (Sports, News, etc.), Application-Specific Content (New on Media Provider 1, New on Media Provider 2, etc.), Golf, etc.). In this way, the electronic device facilitates the ability for the user to easily browse and discover media by category, improving the efficiency of interaction between the user and the electronic device.

[0206] While the media navigation user interface is displaying a second multiple representation of a recommended media item corresponding to a recommended media item within each media category (for example, a media item displayed after the user selects a media category), the electronic device optionally receives a second navigation input via one or more input devices, as shown in Figures 8J-8L, etc., that corresponds to a request to scroll between the second multiple representations of the recommended media item (for example, a swipe input detected on the touch-sensitive surface of one or more input devices, which moves the current focus from one representation to another according to the magnitude and / or direction of the swipe input) (936). In response to the reception of the second navigation input, the electronic device optionally scrolls between multiple second representations of the recommended media item (938), revealing multiple second media category user interface elements corresponding to media subcategories within each media category (for example, media category user interface elements corresponding to other media categories within the selected media category) in the media navigation user interface. The multiple second representations of the recommended media item are displayed without displaying the multiple second media category user interface elements in Figures 8J-8L, etc., before receiving the second navigation input (for example, if movies are the selected category, another filter is by genre; if TV shows are the selected category, another filter is by genre; if kids are the selected category, another filter is by age range, etc.). In this way, the electronic device facilitates the user's ability to easily browse and discover media by category, improving the efficiency of user-device interaction. In addition, by displaying recommended content before displaying category filter options, it provides the user with a content-first experience, increases the amount of playable media items displayed on the screen for playback, reduces the amount of user input before the user selects playable media items, and increases the efficiency of device usage.

[0207] In some embodiments, upon determination that media restrictions (e.g., parental restrictions, or restrictions preventing viewing of media with predetermined content designations, such as R-rated movies) are in effect on the electronic device, the recommended media items corresponding to the first and second multiple representations of the recommended media items exclude (e.g., do not include) media items restricted by the media restrictions, as shown in Figure 8V, etc. (940) (for example, when media restrictions are in effect, the media displayed in the media navigation user interface is limited to media permitted by the media restrictions). Therefore, in some embodiments, the user can only browse media permitted by the media restrictions. In this way, the electronic device facilitates the user's ability to easily browse and discover unrestricted media, improving the efficiency of interaction between the user and the electronic device.

[0208] While media restrictions are in effect on the electronic device, the electronic device selectively receives inputs via one or more input devices, such as in Figure 8DD, that correspond to requests to perform a search across all media items accessible by the electronic device (e.g., inputs to search for a predetermined media item, inputs to search for media items having predetermined characteristics such as comedy or movies) (942). In response to receiving inputs that correspond to requests to search across all media items accessible by the electronic device, the electronic device selectively searches for media items accessible by the electronic device, including media items restricted by media restrictions, as shown in Figure 8DD (944) (for example, even if media restrictions are in effect, a search performed on the electronic device will search all media accessible by the electronic device regardless of the media restrictions). In some embodiments, searching for media items accessible by the electronic device includes searching for media items to which the user of the electronic device has been granted the right to access the electronic device, without searching for media items to which the user of the electronic device has not been granted the right to access the electronic device (946) (for example, the media search is performed across all media regardless of media restrictions, but only media to which the user has been granted the right to view is searched). Therefore, electronic devices enable users to discover media that is restricted and / or to which they are entitled by media restrictions, facilitate the ability for users to discover media to which they are entitled on the electronic device, and improve the efficiency of user-electronic device interaction.

[0209] While media restrictions are in effect on the electronic device, the electronic device optionally receives input via one or more input devices that corresponds to a request to play a search result media item obtained from a media item search (for example, the selection of a search result media item after the electronic device displays the search result media item in response to a media search performed by the user) (948), and the search result media item is restricted by the media restrictions on the electronic device, as shown in Figure 8EE, etc. (for example, the search result media item is not permitted by the media restrictions because its content specification is outside the permitted content specification). In response to receiving a request to play a search result media item, the electronic device optionally displays a visual indication on the display, as shown in Figure 8FF, etc., indicating that the search result media item is restricted by the media restrictions on the electronic device, without playing the search result media item on the electronic device (950) (for example, if the user selects to play a restricted media item in the search results, the electronic device displays a warning that the media item is restricted and will not be played). Thus, the electronic device facilitates the user's ability to determine that a media item is restricted and / or that media restrictions are in effect, improving the efficiency of user-electronic device interaction.

[0210] In some embodiments, the media navigation user interface further includes a library user interface element corresponding to a media library (e.g., a collection of media items), the media library containing media items that the user of the electronic device has selected to include in the media library (e.g., media items that the user likes (or has specified to include in the media library), purchased, borrowed, etc.) (952). The media library is optionally a collection of media items different from recommended media items, because the media items included in the media library are optionally included there for explicit user actions on those media items, while recommended media items may or may not be included in the recommended media items for explicit user actions on those media items. In some embodiments, the electronic device receives input via one or more input devices to select a library user interface element (e.g., a click of a button on an input device when the library user interface element has focus) (954). In response to receiving input for selecting library user interface elements, the electronic device optionally replaces, in the media navigation user interface, with multiple representations of media items selected by the user to include in the media library, and representations of recommended media items, as shown in Figure 8W, etc. (956). In some embodiments, the media library includes one or more selectable affordances for sorting the media library by title, date, etc. Thus, the electronic device provides an interface that makes it easy for the user to browse the media they have specified to include in the media library, improving the efficiency of interaction between the user and the electronic device.

[0211] In some embodiments, the media navigation user interface further includes store user interface elements corresponding to media applications that the user of the electronic device is not entitled to view (e.g., applications that the user has not purchased or downloaded, or for which the user does not have a subscription agreement to access them) (958), as shown in Figure 8X, etc. In some embodiments, the electronic device receives input via one or more input devices to select a store user interface element (e.g., a click of a button on the input device when the store user interface element has focus) (960). In response to receiving input to select a store user interface element, the electronic device optionally replaces in the media navigation user interface multiple representations of media applications that the user of the electronic device is not entitled to view, and a representation of recommended media items, as shown in Figure 8X, etc. (962). In some embodiments, multiple representations of media applications are displayed without displaying representations of media applications that the user of the electronic device is not entitled to access (964) (e.g., only representations of applications for which the user is not entitled to access content are displayed). In this way, electronic devices provide users with quick access to media applications that are not installed on the electronic device and / or to which the user has not been granted the right to access the media, thereby improving the efficiency of interaction between the user and the electronic device.

[0212] In some embodiments, a representation of a media application includes one or more representations corresponding to media subscription agreements available to the user of the electronic device (e.g., subscription agreements to applications where media is available from media provider 1, media provider 2, etc.), and each representation corresponding to each media subscription agreement available to the user includes visual representations of the media that become accessible to the user via the corresponding media subscription agreement, as shown in Figure 8X, etc. (966) (for example, a representation of a media subscription agreement includes instructions for the media that become accessible to the user if the user subscribes to the media subscription agreement). For example, a representation of media provider 1 optionally includes graphics of programs available from media provider 1, and a representation of media item 2 optionally includes graphics of programs available from media provider 2, and so on. In this way, the electronic device easily provides accessible information about media that the user can access via a subscription agreement to a given media provider, improving the efficiency of interaction between the user and the electronic device.

[0213] In some embodiments, a user of an electronic device has a subscription agreement with a media provider that grants the user access to media through multiple media applications, including a first set of media applications not installed on the electronic device (968) (for example, the user is a customer of a cable television company, and through the user's account with the cable television company, the user can view media from multiple media applications, such as an application for a first media provider, an application for a second media provider, etc.). In some embodiments, as shown in Figure 8Y, multiple representations of media applications are displayed without displaying representations of media applications within the first set of media applications (970) (for example, even if the first set of media applications is not installed on the electronic device, it is optionally not displayed in the store user interface because the user has already been granted the right to access content through those applications due to the user's account with the cable television company). In this way, the electronic device does not display information that may not be of interest to the user of the electronic device (for example, representations of media applications to which the user has already been granted the right to access media), thereby improving the efficiency of interaction between the user and the electronic device.

[0214] In some embodiments, each of the multiple provider media applications provides access to media items from each media provider, and it includes a first media application that provides access to media items from each media provider and a second media application that provides access to media items from each media provider (972) (for example, a given media provider has multiple media applications that can provide access to media on the media provider). For example, a media provider may have a first application that provides access to media based on a user's subscription agreement with a cable television company (for example, an indirect subscription agreement to the media provider via the user's subscription agreement with the cable television company) and a second application that provides access to media based on a direct subscription agreement to the media provider. In some embodiments, the first media application is installed on an electronic device, and the user of the electronic device has a subscription agreement to the first media application that provides access to media items from each media provider (974) (for example, the user has already downloaded and authenticated one of the media applications that can access media from the media provider). In some embodiments, the second media application is not installed on the electronic device, as shown in Figures 8Y-8Z, etc. (976) (for example, other media applications that access media from a media provider are not downloaded, installed, and / or authenticated on the electronic device).In some embodiments, as shown in Figure 8Z, multiple representations of a media application are displayed without displaying a second media application (978) (for example, even if several media applications that access media from a given media provider are not installed on the electronic device, they are not optionally displayed within the store user interface because the user has already installed and authenticated different media applications that access media from a given media provider). In some embodiments, multiple representations of a media application are displayed without displaying a representation of each of the multiple provider media applications. In this way, the electronic device does not display information that may not be of interest to the user of the electronic device (for example, duplicate representations of media applications), thereby improving the efficiency of interaction between the user and the electronic device.

[0215] In some embodiments, the media navigation user interface further includes a search user interface element, as shown in Figure 8BB, etc., for searching media accessible by the electronic device (980). In some embodiments, the electronic device receives input via one or more input devices to select a search user interface element (e.g., a click of a button on the input device when the search user interface element has focus) (982). In response to receiving input to select a search user interface element, the electronic device optionally replaces the media navigation user interface with a search interface for searching media accessible by the electronic device and a representation of recommended media items (984), the search interface including user-configurable options, as shown in Figure 8BB, etc., for searching only media accessible by the electronic device, or media accessible by the electronic device to which the user of the electronic device has been granted the right to access (e.g., the user has the option to search all media accessible by the electronic device, or only media to which the user has been granted the right to view). In some embodiments, the search from the search interface is performed while media restrictions are being enforced on the electronic device, as already described (e.g., in step 942, etc.). In such embodiments, the search selectively searches for all media accessible by the electronic device, regardless of media restrictions, as shown in Figure 8DD and step 942, etc. In some embodiments, if the user attempts to play a media item found by the search but restricted by media restrictions (e.g., in step 948, etc.), the electronic device displays a warning that the media item is restricted and will not be played, as already described in Figure 8FF and step 950, etc.

[0216] Naturally, the specific order in which the operations in Figures 9A–9I are described is illustrative only, and does not indicate that the described order is the only possible order in which the operations can be performed. Those skilled in the art will be able to recognize various ways of changing the order of the operations described herein. In addition, naturally, other processing details described herein are applicable to other methods described herein (e.g., methods 700, 1100, 1300, and 1900) in the same way as method 900 described above for Figures 9A–9I. For example, the integrated media browsing application and user interface, recommended media items, topical media items, media applications, representations of recommended and topical media items, and media providers described above with reference to method 900 may optionally have one or more features of the integrated media browsing application and user interface, recommended media items, topical media items, media applications, representations of recommended and topical media items, and media providers described herein with reference to other methods described herein (e.g., methods 700, 1100, 1300, and 1900). For the sake of simplicity, these details will not be repeated here.

[0217] The operation of the information processing method described above is optionally performed by executing one or more functional modules within an information processing device such as a general-purpose processor or an application-specific chip (for example, as described in Figures 1A, 3, 5A, and 15). Furthermore, the operation described above with reference to Figures 9A to 9I is optionally performed by the components shown in Figures 1A to 1B. For example, it is optionally performed by the receiving operations 902, 906, and 910, the display operation 904, the scrolling operation 908, and the replacement operation 912, the event sorter 170, the event recognition unit 180, and the event handler 190. The event monitor 171 in the event sorter 170 detects contacts on the touch-sensing surface 604, and the event dispatcher module 174 sends event information to application 136-1. Each event recognition unit 180 in application 136-1 compares the event information with each event definition 186 and determines whether the first contact at the first position on the touch-sensing surface corresponds to a predetermined event or sub-event, such as the selection of an object on the user interface. When a predetermined event or sub-event is detected, the event recognition unit 180 activates an event handler 190 associated with the detection of that event or sub-event. The event handler 190 optionally uses or calls a data updater 176 or an object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses each GUI updater 178 to update what is displayed by the application. Similarly, methods for performing other processing based on the components shown in Figures 1A-1B will be apparent to those skilled in the art. Unified Media Browsing Application Settings

[0218] Users interact with electronic devices in many different ways, including interacting with media (e.g., music, movies, etc.) that may be available on the electronic device (e.g., stored or otherwise accessible). For example, users can browse and play media accessible on the electronic device in a unified media browsing application (as described with reference to, for example, Figures 6A-6LL, 8A-8GG, 10A-10Z, 12A-12V and / or Figures 18A-18J). However, in some situations, permission from the user may be required for media from different media applications to be viewable in the unified media browsing application, allowing the corresponding media provider to share user-specific information with the unified media browsing application (e.g., information about the user's behavior regarding media on those media providers). The embodiments described below provide a way for an electronic device to facilitate the setup of a unified media browsing application, thereby improving user interaction with the electronic device. Improving interaction with the device reduces the time required for the user to perform operations, thus reducing the power consumption of the device and extending the battery life of battery-powered devices. It is understood that people use the device. When a person uses a device, that person is optionally referred to as the device's user.

[0219] Figures 10A to 10Z illustrate exemplary methods, according to some embodiments of the present disclosure, in which an electronic device facilitates the configuration of a unified media browsing application. These graphical embodiments are used to illustrate the processes described below, including the processes described with reference to Figures 11A to 11F.

[0220] Figure 10A shows an exemplary display 514. The display 514 optionally displays one or more user interfaces containing various content. In the example shown in Figure 8A, the display 514 displays the home screen user interface 1005n of an electronic device to which the display 514 is part or to which the display 514 is connected (e.g., electronic device 500 in Figure 5A). The user interface 1005 optionally includes an application browsing user interface of the electronic device's operating system, which contains icons for different applications installed on the electronic device, and the icons are selectable to launch their corresponding applications on the electronic device. For example, the user interface 1005 includes icons 1018-1 to 1018-5 that are selectable to launch different applications on the electronic device. Icon 1018-1 is selectable to launch the unified media browsing application (for example, the unified media browsing application as described with reference to Figures 6A to 6LL), icon 1018-2 is selectable to launch the settings application (for example, the settings of user interface 1003 in Figure 10Q are optionally accessible), icon 1018-3 is selectable to launch the media application corresponding to media provider 1, icon 1018-4 is selectable to launch the media application corresponding to media provider 2, and icon 1018-5 is selectable to launch the media application corresponding to media provider 3. In Figure 10K, icon 1018-3 has the current focus, as indicated by the dashed box within it.

[0221] The user interface 1005 also includes an area above icon 1018 (e.g., a “top shelf” area) which optionally displays one or more user interface elements corresponding to the application for which icon 1018 has the current focus. For example, in Figure 10A, icon 1018-3, which corresponds to media provider 1, has the current focus. As a result, the electronic device displays representations 1023-1 to 1023-4 of media items accessible from media provider 1 in the “top shelf” area of ​​the user interface 1005. Representation 1023 optionally includes information identifying each media item (e.g., text information) and / or information about the content of each media item (e.g., a video preview of the media item, a still image of the media item, etc.). In some embodiments, the "Top Shelf" area is a scrollable area containing representations of suggested media items for the application currently highlighted on the home screen, and an upward swipe, upon selection (e.g., by a tap or click input on a remote control), moves the current focus to one representation of the suggested media items and causes the device to start playing the media item corresponding to the representation of the suggested media item with current focus.

[0222] In Figure 10B, a right-to-left swipe of contact 608 is detected on the touch-sensitive surface 604, causing icon 1018-1, corresponding to the Unified Media Browsing Application, to gain the current focus. As a result, the electronic device displays user interface elements 1020-1 and 1020-2, corresponding to the Unified Media Browsing Application, in the "Top Shelf" area of ​​the user interface 1005. In Figure 10L, the Unified Media Browsing Application is not yet authorized to function as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device (see, for example, later). Therefore, user interface element 1020 is an information item related to the Unified Media Browsing Application, and not a representation of media items that will become viewable in the Unified Media Browsing Application once authorized. Specifically, user interface element 1020-1 is, for example, a video (or a link to a video) describing how to set up the Unified Media Browsing Application, and user interface element 1020-2 is a video (or a link to a video) describing how to use the Unified Media Browsing Application. While the Unified Media Viewing application has the current focus, an upward swipe, upon selection (e.g., via a tap or click input on a remote control), moves the current focus to a representation of one of the information items associated with the Unified Media Viewing application, and causes the device to start playing the media item (e.g., a demo video) corresponding to the information item associated with the Unified Media Viewing application that has the current focus.

[0223] In Figure 10B, after a right-to-left swipe of contact 608 is detected on the touch-sensitive surface 604, a click is detected on the touch-sensitive surface 604, and therefore representation 1018-1 is selected. As a result, the electronic device launches and displays the Unified Media Browsing Application, as shown in Figure 10C. In Figure 10C, the Unified Media Browsing Application is not yet authorized to function as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device in order to facilitate easy browsing and viewing of those media items by the user of the electronic device. Therefore, the user interface 1002 displayed by the Unified Media Browsing Application includes a button 1007 for setting and / or authorizing the Unified Media Browsing Application to operate in this manner. Furthermore, the user interface 1002 includes information items 1006 and 1008 related to the Unified Media Browsing Application. Specifically, the user interface 1002 includes item 1006, which is a video (or link to a video) describing how to set up the Unified Media Browsing Application, and item 1008, which is a video (or link to a video) describing how to use the Unified Media Browsing Application. Item 1008 has the current focus in Figure 10C, and as shown by 1011 in Figure 10C, button 1007, as well as items 1006 and 1008, are overlaid on a background image / video corresponding to the “How to Use” video corresponding to item 1008. Before the Unified Media Browsing Application is set up / allowed, in some embodiments, the user interface 1002 does not include a representation of the media available from various media applications installed on the electronic device. However, in some embodiments, the user interface 1002 includes a partial representation of trending media items (e.g., top movies), as shown in Figure 10C.

[0224] In Figure 10D, a left-to-right swipe of contact 608 on the touch-sensitive surface 604 is detected, moving the current focus to button 1007, and a click on the touch-sensitive surface 604 is detected while button 1007 has the current focus. Accordingly, the electronic device initiates a process to enable media available from various media applications installed on the electronic device to be viewed in the Unified Media Browsing Application. For example, as shown in Figure 10E, depending on the selection of button 1007 in Figure 10D, the electronic device displays a dialog box 1012 containing rows 1010-1 to 1010-3 of representations of media providers 1, 2, and 3. Representation 1010 corresponds to a media provider whose media becomes viewable in the Unified Media Browsing Application when the Unified Media Browsing Application is configured / allowed. Representation 1010 is optionally a textual and / or graphical representation of the media provider (e.g., the media provider's logo, the icon of the media application corresponding to the media provider, etc.). If the list of media providers is long (for example, longer than a threshold such as 5, 10, or 15), the rows of representation 1010 are animated to scroll horizontally to automatically display all representations 1010 over time. Additionally or alternatively, the dialog box 1012 includes a “Browse All” button 1015 that allows the user to expand the dialog box 1012 to display all media providers to be added to the Unified Media Browsing application in the grid of representation 1010. In some embodiments, multiple representations 1010 of an application correspond to applications associated with a user account of a user on an electronic device, such as applications downloaded to an electronic device logged into a user account, or applications downloaded to other electronic devices similarly associated with the user account (for example, logged into the user account).In some embodiments, multiple representations 1010 of an application correspond to applications downloaded to an electronic device and to which the user is logged (for example, the user has provided access credentials to the application so that the application provides access to those corresponding media). The dialog box 1012 also includes selectable buttons 1014 to allow media providers corresponding to representation 1010 to share user-specific information with the Unified Media Browsing Application (for example, information about user behavior regarding media on those media providers, such as media purchase behavior, media rental behavior, media favorite / bookmarking behavior, and media viewing behavior).

[0225] In Figure 10F, a click on the touch-sensitive surface 604 is detected while button 1014 has the current focus. As described above, selecting button 1014 grants permission to media providers 1, 2, and 3 (corresponding to representation 1010) to share user-specific information with the unified media browsing application. After receiving the above permission, the unified media browsing application stops displaying button 1007 and information items 1006 and 1008 shown in Figures 10C to 10D and begins displaying representations of media items accessible from media providers 1, 2, and 3. For example, as shown in Figure 10G, the user interface 1002 includes representations 1004-1 to 1004-6 of various media items accessible from media providers 1, 2, and 3. Initially, after the unified media browsing application has been granted permission as described above, representation 1004 optionally corresponds to trending media items such as top TV programs (e.g., media items not selected to be included in the user interface 1002 based on the viewing activity of the user of the electronic device). For example, trending media items are, at their discretion, media items that are popular with other viewers, or otherwise selected by a third party (e.g., selected by a media provider to include in user interface 1002 to promote the media items). When a user of an electronic device takes action regarding media items accessible on the electronic device (e.g., watching a media item, renting a media item, purchasing a media item, etc.), the trending media items in user interface 1002 are replaced with media items selected to include in user interface 1002 based on the user's viewing activity, as will be described in more detail below.

[0226] Instead of selecting button 1007 to configure and authorize the Unified Media Browsing Application, selecting a representation of a media item in the Unified Media Browsing Application also optionally triggers the configuration / authorization of the Unified Media Browsing Application. For example, in Figures 10H to 10I, a downward swipe of touch 608 is detected on the touch-sensitive surface 604, causing the electronic device to scroll the user interface 1002 and bring the current focus to representations 1004-11 corresponding to top TV programs. In Figure 10J, the selection of representation 1004-11 is detected. Accordingly, the electronic device displays a dialog box 1012, as shown in Figure 10K, and after authorization, displays the Unified Media Browsing Application, as shown in Figure 10L. As described above, the trending media items in the user interface 1002 in Figure 10L are replaced by media items selected to be included in the user interface 1002 based on the user's viewing activity, as will be explained below.

[0227] For example, in Figure 10M, the electronic device plays media item B via media provider 3 in a media application corresponding to media provider 3 (in response to user input for viewing media item B, for example). After media item B has been partially viewed on the electronic device, as shown in Figure 10N, a representation 1005-1 corresponding to media item B from media provider 3 is included in the user interface 1002. In particular, representations 1004-6 (Figure 10L) of trending media item L are removed from the user interface 1002 (for example, pushed out from the edge of the user interface 1002), and representation 1005-1 of media item B, which the user partially viewed, is added to the user interface 1002. Since additional representations of media items are added to the user interface 1002 by the user's viewing activity, additional representations of trending media items are similarly replaced in the user interface 1002. For example, in Figure 10O, the electronic device plays media item A via media provider 2 in a media application corresponding to media provider 2 (in response to user input for viewing media item A, for example). After media item A has been partially viewed on an electronic device, as shown in Figure 10P, a representation 1005-2 corresponding to media item A from media provider 2 is included in the user interface 1002, replacing another representation of the trending media item in the user interface 1002 (e.g., representation 1004-5 of trending media item K). In some embodiments, even after the trending content has been pushed off the screen by the “next” content selected based on the user’s activity with the content, the user can scroll to the next content (e.g., by swiping right on a touch-sensitive surface) to redisplay the trending content on the display and scroll to the “next” content off the display. In some embodiments, the trending content changes based on the sum of activity from multiple users (e.g., the trending content shows content viewed by a large number of users within a given period, such as the past hour, day, week, or month).

[0228] In some embodiments, the electronic device provides a configuration user interface for individually managing the permissions of each media provider to share user-specific information with the Unified Media Browsing Application. For example, in Figure 10Q, user interface 1003 is such a configuration user interface. User interface 1003 is optionally the user interface of the Unified Media Browsing Application itself, or the user interface of the operating system of an electronic device outside the Unified Media Browsing Application. User interface 1003 gives the user the ability to individually permit or dispermit media providers 1, 2, and 3 to share user-specific information with the Unified Media Browsing Application. For example, in Figure 10Q, the user interface 1003 includes a toggle 1016-1 for allowing or disallowing the sharing of user-specific information by media provider 1 with the unified media browsing application (not permitted in Figure 10Q), a toggle 1016-2 for allowing or disallowing the sharing of user-specific information by media provider 2 with the unified media browsing application (permitted in Figure 10Q), and a toggle 1016-3 for allowing or disallowing the sharing of user-specific information by media provider 3 with the unified media browsing application (not permitted in Figure 10Q). The user interface 1003 also optionally includes a toggle 1016-4 for enabling or disabling (disabled in Figure 10Q) the private media browsing mode on the electronic device, as described with reference to Figures 6FF to 6LL, and a button 1017 for the option to optionally delete all user data related to media viewing activity on the electronic device.

[0229] Figure 10R shows the home screen user interface 1005 of the electronic device. The home screen user interface 1005 is optionally accessible from the Unified Media Browsing Application in response to an input detected on the remote control that responds to a request to return to the home screen user interface 1005 (for example, when within the Unified Media Browsing Application, the selection of the "Home" button 518 or the "Menu" button 516 on the remote 510 as described with reference to Figure 5B). In Figure 10R, the Unified Media Browsing Application is permitted to function as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device (for example, as described with reference to Figures 10C to 10L), and the icon 1018-1 corresponding to the Unified Media Browsing Application maintains its current focus. Since the Unified Media Browsing Application is now authorized, the electronic device replaces the display of user interface element 1020 (shown in Figure 10B) with the display of representations 1022-1 to 1022-4 of media items accessible from media providers 1, 2, and 3 in the "Top Shelf" area of ​​user interface 1005, from within the Unified Media Browsing Application.

[0230] In Figure 10S, the media application corresponding to media provider 4 is installed on the electronic device after the unified media browsing application has been authorized to function as a centralized media navigation application, as indicated by the addition of icon 1018-6 to the user interface 1005. Therefore, media provider 4 is not yet authorized to share user-specific information with the unified media browsing application. The electronic device optionally requests such authorization when the unified media browsing application or the media application corresponding to media provider 4 is next launched. In some embodiments, the electronic device requests such authorization when a media item provided by media provider 4 is selected for playback in the unified media browsing application. For example, in Figure 10O, a click on the touch-sensitive surface 604 is detected while icon 1018-1 corresponding to the unified media browsing application has the current focus. Accordingly, the electronic device launches the unified media browsing application, as shown in Figure 10U. In Figure 10U, a click on the touch-sensitive surface 604 is detected while representation 1004-20 corresponding to media item ZZ from media provider 4 has the current focus. Accordingly, the electronic device prompts the user to allow the media provider 4 to share user-specific information with the unified media browsing application, as shown in Figure 10V. Specifically, the electronic device displays a prompt 1024 containing a representation of the media provider 4, a button 1026 that allows the media provider 4 to share user-specific information with the unified media browsing application, and a button 1027 that prevents the media provider 4 from sharing user-specific information with the unified media browsing application. In Figure 10W, a click on the touch-sensitive surface 604 is detected while button 1026 has the current focus, and as a result, the media provider 4 is allowed to share user-specific information with the unified media browsing application.Depending on the selection of button 1026 in Figure 10W, the electronic device will start playing media item ZZ from media provider 4, as shown in Figure 10X, without any further user input.

[0231] In some embodiments, the electronic device responds differently to the launch of the Unified Media Browsing Application (as described with reference to Figures 10A-10C, for example) depending on whether a media application is currently installed on the electronic device when the Unified Media Browsing Application is launched, and / or the number of times the Unified Media Browsing Application has been launched, in situations where the Unified Media Browsing Application is not yet permitted to function as a centralized media navigation application as described above. For example, when the Unified Media Browsing Application is launched for the first time when no media application is installed on the electronic device, the Unified Media Browsing Application optionally displays a dialog box containing information about the Unified Media Browsing Application, as shown in Figure 10Y, without displaying any specific media applications that the user may install on the electronic device.

[0232] However, when no media applications are installed on the electronic device, the Unified Media Browsing Application is launched a second time (and optionally thereafter), and the Unified Media Browsing Application optionally displays a dialog box containing representations of specific media applications (e.g., characteristic media applications, or media applications that are part of a specific media application bundle or pack, such as a sports pack or a movie pack) that the user can install on the electronic device along with those applications (e.g., representations of media applications corresponding to media provider 5, media provider 6, and media provider 7) as shown in Figure 10Z, and begin using the Unified Media Browsing Application. The user can optionally install media applications individually (e.g., by individually selecting representations of media applications) and begin authorizing the Unified Media Browsing Application using the selected media applications / providers (e.g., as described with reference to Figures 10E-10G), or (e.g., by selecting the "Download All" link in the dialog box) and begin authorizing the Unified Media Browsing Application using all the displayed media applications / providers (e.g., as described with reference to Figures 10E-10G). In this way, the electronic device only prompts the user to download / install the media application after the user has already launched the unified media browsing application at least once previously, thus avoiding unnecessarily inconveniencing the user by presenting such information.

[0233] It should be noted that in some embodiments, if a media application is not installed on the electronic device, the electronic device will display the dialog box shown in Figure 10Z when the unified media browsing application is launched for the first time, rather than waiting until the unified media browsing application is launched a second time (for example, the electronic device will not display the dialog box shown in Figure 10Y).

[0234] In some embodiments, the Unified Media Browsing Application is not yet permitted to function as a centralized media navigation application as described above, but when the Unified Media Browsing Application is launched for the first time while one or more media applications are installed on the electronic device, the electronic device optionally displays the user interface of Figure 10C, and the user can initiate permission for the Unified Media Browsing Application (for example, permission for the Unified Media Browsing Application when one or more media applications are already installed on the electronic device) as described with reference to Figures 10D to 10G. The user can then browse various media items in the Unified Media Browsing Application as described with reference to Figures 10A to 10X. In response to subsequent launches of the Unified Media Browsing Application when media applications are installed on the electronic device, the electronic device optionally displays the dialog box of 10Z, advertising or offering additional media applications (for example, media applications not yet installed on the electronic device) that the user can download to the electronic device and allow the Unified Media Browsing Application to do so.

[0235] Figures 11A to 11F are flowcharts illustrating a method 1100 for facilitating the configuration of a unified media browsing application according to some embodiments of the present disclosure. Method 1100 is optionally performed on an electronic device such as device 100, device 300, or device 500, as described above with reference to Figures 1A to 1B, Figures 2 to 3, and Figures 5A to 5B. Some operations in method 1100 are optionally combined, and / or the order of some operations is optionally changed.

[0236] As described later, Method 1100 provides a method for facilitating the configuration of a unified media browsing application. This method reduces the cognitive burden on the user when interacting with the user interface of the device of this disclosure, thereby creating a more efficient human-machine interface. In the case of battery-powered electronic devices, power can be saved and the battery charging interval can be extended by increasing the efficiency of user interaction with the user interface.

[0237] In some embodiments, an electronic device (e.g., a set-top box such as device 100, device 300, or device 500) that communicates with a display (e.g., a television such as display 514) and one or more input devices (e.g., a remote control such as remote 510, or a smartphone such as device 511) receives input via one or more input devices (1102) (e.g., selection of buttons displayed on the user interface on the display, including multiple representations thereof) that corresponds to multiple applications that provide access to media from multiple media providers (selection of buttons displayed on the user interface on the display, including multiple representations thereof) (e.g., an onboarding or initialization button is displayed on the unified media browsing application running on the electronic device and is selected by the user to configure the unified media browsing application). In some embodiments, the multiple applications include a first application that provides access to first media from a first media provider and a second application that provides access to second media from a second media provider, as shown in Figure 10E. The unified media browsing application optionally functions as a centralized application from which media available through multiple different applications are browsed. The Unified Media Browsing Application optionally displays a button, as shown in Figure 10C, before the user allows the Unified Media Browsing Application to view media available through multiple different applications. After the Unified Media Browsing Application is allowed to view media available through multiple different applications, the Unified Media Browsing Application optionally stops displaying the button, as shown in Figure 10G.

[0238] In response to receiving input corresponding to a request to configure a unified media browsing application for browsing media corresponding to multiple applications that provide access to media from multiple media providers, the electronic device initiates a process to enable media accessible through multiple applications on the electronic device to be browsed in the unified media browsing application, as shown in Figures 10E to 10F (1104) (for example, initiating a process to allow the unified media browsing application to display media available to the user of the electronic device through multiple different applications). In some embodiments, the unified media browsing application is different from the multiple applications on which the media is accessible. In some embodiments, initiating a process to enable media to be browsed in the unified media browsing application includes an electronic device that simultaneously displays on a display, as shown in Figure 10E, a representation of a first media provider (1106) and a representation of a second media provider (1107) (for example, a list of different applications on the electronic device on which the unified media browsing application displays media that is accessible and viewable by the user in the unified media browsing application), as well as selectable affordances (1109). In some embodiments, a list of different applications includes images corresponding to those applications (e.g., application icons for those applications) and / or text corresponding to those applications (e.g., the names of those applications).In some embodiments, the selectable affordance, when selected, provides permission to multiple media providers to share user-specific information with the unified media browsing application, including user-specific information from a first media provider corresponding to user actions regarding media available through the first application (e.g., purchase, rental, favorite / bookmarking, viewing, etc.) and user-specific information from a second media provider corresponding to user actions regarding media available through the second application (e.g., purchase, rental, favorite / bookmarking, viewing, etc.), as shown in Figure 10F. In this way, the electronic device provides a simple process for authorizing the unified media browsing application, provides information about media providers that are part of the authorization in an easily accessible manner, and thus improves the efficiency of user electronic device interaction.

[0239] In some embodiments, multiple representations of an application correspond to applications associated with a user account on an electronic device, such as applications downloaded to an electronic device to which the user is logged in to a user account, or applications downloaded to other electronic devices similarly associated with the user account (e.g., logged in to the user account) (1108). In some embodiments, multiple representations of an application correspond to applications downloaded to an electronic device to which the user is logged in (1110) (e.g., the user has provided access credentials to the application so that the application provides access to its corresponding media).

[0240] Before initiating the process to enable media accessible through multiple applications on an electronic device to be viewed in the Unified Media Viewing Application, the Unified Media Viewing Application optionally displays information items about the Unified Media Viewing Application on the display, as shown in Figure 10C (1112) (e.g., a demo video of how the Unified Media Viewing Application works, a how-to video explaining how to set up the Unified Media Viewing Application, etc.). In some embodiments, before initiating the process to enable the Unified Media Viewing Application to provide viewable media, as shown in Figure 10C, the Unified Media Viewing Application does not display media accessible through multiple applications. After the user selects an affordance that allows multiple media providers to share user-specific information with the Unified Media Viewing Application, the Unified Media Viewing Application optionally displays a representation of media items accessible from multiple applications on the display, as shown in Figure 10G (1114) (e.g., after the Unified Media Viewing Application is permitted to display viewable media, the information items about the Unified Media Viewing Application optionally replace the media accessible from multiple applications).

[0241] In response to the detection of an affordance selection that provides permission for multiple media providers to share user-specific information with the Unified Media Browsing Application, the Unified Media Browsing Application optionally displays trending media items (e.g., media items selected for inclusion in the Unified Media Browsing Application that are not based on the user's browsing behavior on the electronic device) on the display, as shown in Figure 10G (1116). For example, media popular with other viewers, or otherwise selected by a third party, are optionally included in the trending media items. After detecting an affordance selection that provides permission for multiple media providers to share user-specific information with the Unified Media Browsing Application, the electronic device optionally detects one or more user actions that cause additional media items to be included in the Unified Media Browsing Application (e.g., favorite, watch, rent, buy, etc.) as shown in Figure 10M (1118). In response to the detection of one or more user actions, the electronic device optionally replaces the display of the trending media items in the Unified Media Browsing Application with the display of the additional media items, as shown in Figure 10N (1120). For example, if user behavior leads to the addition of more media items to the unified media browsing application, trending media items are replaced by the user's media items (for example, trending media items are pushed off the edges of the screen when they are replaced by the user's media items). In this way, the electronic device shifts to displaying media items that are likely to be of particular interest to the user (for example, because they are selected based on user behavior), facilitating user access to such media items and thus improving the efficiency of user interaction with the electronic device.

[0242] In some embodiments, the input corresponding to a request to configure a Unified Media Browsing Application is a selection of buttons displayed in the user interface of the Unified Media Browsing Application, as shown in Figure 10D (1122) (for example, the buttons are optionally displayed in the user interface, and representations of media accessible through multiple applications are displayed when permitted by the user). In some embodiments, as shown in Figure 10E, representations of a first media provider and a second media provider are displayed in a row of representations of multiple media providers (1124). If the number of media providers to be added to the Unified Media Browsing Application exceeds a threshold number (e.g., 5, 8, or 10), in some embodiments, the row of representations of media providers is animated to scroll through the representations of media providers.

[0243] In some embodiments, the electronic device receives input via one or more input devices, as shown in Figure 10F, to select a selectable affordance (e.g., a click of a button on the input device when a selectable affordance is in focus) (1126). In response to receiving input to select a selectable affordance, the electronic device optionally displays the Unified Media Viewing Application on the display, as shown in Figure 10G (1128) (e.g., after the user has permitted media providers to share user-specific information with the Unified Media Viewing Application, the Unified Media Viewing Application displays representations of media from those applications). The Unified Media Viewing Application and the user interface, including the representations of media items it displays, are optionally the Unified Media Viewing Application and corresponding user interfaces described in Methods 700 and 900. Thus, the electronic device provides a simple process for enabling the Unified Media Viewing Application to display representations of media items from multiple media providers, and thus improves the efficiency of user electronic device interaction.

[0244] After detecting a selection of affordances that provide permission for multiple media providers to share user-specific information with the Unified Media Browsing Application, the electronic device optionally downloads the respective applications that provide access to media from each media provider to the electronic device, as shown in Figure 10S (1130) (for example, the user downloads the media applications to the electronic device after granting permission to the media providers to share user-specific information with the Unified Media Browsing Application). In some embodiments, after downloading the respective applications, the electronic device launches the Unified Media Browsing Application or the respective applications on the electronic device, as shown in Figure 10U (1132) (for example, the user launches either the Unified Media Browsing Application or the respective applications). In response to launching the Unified Media Browsing Application or the respective applications on the electronic device (or in response to detecting input from within the Unified Media Browsing Application requesting playback of a media item using the respective application), the electronic device optionally displays the selectable affordances on the display, as shown in Figure 10V (1134). When selected, the selectable affordance optionally grants permission to each media provider to share user-specific information with the unified media browsing application, including user-specific information from each media provider corresponding to user actions regarding media available through each application (e.g., purchase, rental, favorite / bookmarking, viewing, etc.), as shown in Figure 10V. In some embodiments, since each application is downloaded after the user has provided the initial permission to share user-specific information with the unified media browsing application, additional permissions are optionally required for each application, as described above.Therefore, the electronic device provides a simple process for allowing the media provider corresponding to the newly downloaded application to share user-specific information with the unified media browsing application, thereby improving the efficiency of user-electronic device interaction.

[0245] In some embodiments, the electronic device displays on the display an application browsing user interface (1136) that includes multiple selectable representations of multiple applications on the electronic device (for example, the electronic device's home screen which includes icons of different applications installed on the electronic device, the icons which are selectable to launch their corresponding applications on the electronic device), a selectable representation which is selectable to open the corresponding application on the electronic device, and a selectable representation which is selectable to open the Unified Media Browsing Application on the electronic device. When the selectable representation of the Unified Media Browsing Application has focus, the electronic device optionally displays one or more user interface elements corresponding to the Unified Media Browsing Application in the applicati...

Claims

1. It is a method, In an electronic device that communicates with a display and one or more input devices, The configuration includes receiving a sequence of one or more inputs corresponding to a request to configure the electronic device via one or more input devices, wherein the configuration includes configuring a unified media browsing application to browse media corresponding to multiple applications that provide access to media from multiple media providers, the multiple applications including a first application that provides access to first media from a first media provider and a second application that provides access to second media from a second media provider. In response to receiving the sequence of one or more inputs corresponding to the request to configure the electronic device, a process is initiated to enable media accessible via the plurality of applications on the electronic device to be viewed in the Unified Media Viewing Application, wherein the Unified Media Viewing Application, unlike the plurality of applications that can access the media via the plurality of applications, initiates the process to enable the media to be viewed in the Unified Media Viewing Application. When selected, it displays selectable affordances that grant permission to share user-specific information associated with the user with the Unified Media Browsing Application to the multiple media providers, In response to detecting the selection of the aforementioned affordance, To grant permission to the multiple media providers to share user-specific information with the Unified Media Browsing Application, wherein the permission to the multiple media providers to share user-specific information with the Unified Media Browsing Application is necessary for the Unified Media Browsing Application to access the user-specific information, and the user-specific information is User-specific information from the first media provider, corresponding to user behavior regarding media available through the first application, Including user-specific information from the second media provider, which corresponds to user behavior regarding media available through the second application, That thing, This includes, After detecting the selection of the affordance that grants permission to share the user-specific information with the Unified Media Browsing Application to the multiple media providers, the display shows the representation of the trending media item in the Unified Media Browsing Application. After displaying the representation of the trending media item in the unified media browsing application, one or more user actions that cause additional media items to be included in the unified media browsing application are detected. After detecting one or more user actions, the unified media browsing application displays the representation of the additional media item, which replaces the representation of the trending media item. A method that includes [a certain feature].

2. The method according to claim 1, further, In response to receiving the sequence of one or more inputs corresponding to a request to configure the electronic device, install the plurality of applications on the electronic device. A method that includes [a certain feature].

3. The method according to claim 2, further, Displaying multiple representations of the multiple applications to be installed on the electronic device on the display, A method that includes [a certain feature].

4. The method according to claim 1, wherein the plurality of applications are associated with the user account of the user on the electronic device. method.

5. The method according to claim 1, wherein the plurality of applications are downloaded to the electronic device and logged in to by the user, method.

6. The method according to claim 1, The sequence of one or more inputs corresponding to the request to configure the Unified Media Browsing Application includes the selection of a button displayed on the user interface of the Unified Media Browsing Application. method.

7. The method according to claim 1, further, Displaying a configuration user interface on the display for individually providing permission to the multiple media providers to share corresponding user-specific information with the unified media browsing application, wherein the configuration user interface is: A first toggle that allows the first media provider to share user-specific information from the first media provider that corresponds to the user behavior regarding the media available through the first application, A second toggle that allows the second media provider to share user-specific information from the second media provider that corresponds to the user behavior regarding the media available through the second application, Including, A method that includes [a certain feature].

8. The method according to claim 1, further, On the aforementioned display, A representation of the first application that provides access to the first media from the first media provider, A representation of the second application that provides access to the second media from the second media provider, Displaying simultaneously, A method that includes [a certain feature].

9. The method of claim 8, wherein the representation of the first application and the representation of the second application are displayed in a row of the representation of the plurality of applications that provides access to media from the plurality of media providers, method.

10. The method according to claim 1, Before initiating the process for enabling the media accessible via the plurality of applications on the electronic device to be viewed in the unified media browsing application, the unified media browsing application displays information items related to the unified media browsing application on the display, After the user selects the affordance that grants permission to share the user-specific information with the Unified Media Viewing Application, the Unified Media Viewing Application displays on the display a representation of media items accessible from the multiple applications. method.

11. The method according to claim 1, further, Receiving input via one or more input devices to select the selectable affordances that provide the multiple media providers with permission to share the user-specific information with the unified media browsing application, In response to receiving the input to select the selectable affordances, the Unified Media Browsing Application, which includes a representation of media items accessible from the multiple applications, is displayed on the display. A method that includes [a certain feature].

12. The method according to claim 1, further, After detecting the selection of the affordance that grants permission to share the user-specific information with the unified media browsing application to the multiple media providers, the electronic device downloads individual applications that provide access to media from individual media providers. After downloading the individual applications, launch the unified media browsing application or the individual applications on the electronic device. In response to launching the unified media browsing application or the individual application on the electronic device, the display shows selectable affordances that, when selected, provide the individual media provider with permission to share user-specific information with the unified media browsing application, wherein the user-specific information includes user-specific information from the individual media provider corresponding to user behavior regarding media available through the individual application. A method that includes [a certain feature].

13. The method according to claim 1, further, Displaying an application browsing user interface on the display, which includes a plurality of selectable representations of a plurality of applications on the electronic device, wherein the selectable representations are selectable for opening the corresponding applications on the electronic device, and the selectable representations include a selectable representation of the Unified Media Browsing Application, which is selectable for opening the Unified Media Browsing Application on the electronic device. When the selectable representation of the Unified Media Viewing Application has focus, the application viewing user interface displays one or more user interface elements corresponding to the Unified Media Viewing Application. Equipped with, Before the selectable representation of the Unified Media Viewing Application has the focus, the user interface element corresponding to the Unified Media Viewing Application is not displayed. Before initiating the process to enable the media accessible via the plurality of applications on the electronic device to be viewed in the unified media browsing application, the user interface elements corresponding to the unified media browsing application are information items related to the unified media browsing application, After the user selects the affordance that grants permission to share the user-specific information with the Unified Media Browsing Application to the multiple media providers, the user interface element corresponding to the Unified Media Browsing Application is a representation of media items accessible from the multiple applications. method.

14. The method according to claim 1, wherein, after initiating the process for enabling media accessible via the plurality of applications on the electronic device to be viewed in the unified media browsing application, a third application installed on the electronic device does not have permission to share user-specific information with the unified media browsing application. method.

15. The method according to claim 1, wherein the plurality of applications are installed on the electronic device. method.

16. It is an electronic device, One or more processors, Memory and A system comprising one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing the method according to any one of claims 1 to 15, Electronic devices.

17. A non-temporary computer-readable recording medium storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device causes the electronic device to perform the method according to any one of claims 1 to 15. Non-temporary computer-readable recording medium.