Connected TV devices with media content recommendation and a unified user interface
By providing a unified user interface on connected TV devices and recommending upcoming media content based on user interests and activities, this technology solves the problem that users need to search for content through specific applications in existing technologies. It also integrates multiple content sources and enables media content playback in restricted modes, thereby improving the user experience.
Patent Information
- Application Number
- CN202310807570.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-07-01
- Filing Date
- 2023-07-03
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2043-07-03
AI Technical Summary
In existing technologies, users need to use specific media player applications to search for and browse upcoming media content, lacking a unified knowledge-based media content recommendation and presentation mechanism, resulting in a poor user experience.
A networked TV device is provided that recommends and displays upcoming media content items from multiple content providers based on knowledge of user interests and activities through a unified user interface, organizes content using a tabbed interface, promotes media content in a focused area, and supports media content playback in both restricted and unrestricted modes.
It implements knowledge-based media content recommendation under a unified user interface, which improves user experience, simplifies the content search and browsing process, and supports the integration of multiple content sources and media content playback in restricted modes.
Smart Images

Figure CN116684681B_ABST
Abstract
Description
Technical Field
[0001] The disclosed subject matter generally relates to display technologies, including but not limited to systems and methods for providing knowledge-based media content recommendations, displaying a unified user interface with content-based media recommendations, mixing multiple media content items to be displayed on a focus area, and / or projecting controlled media content associated with a networked television device. More specifically, the disclosed subject matter relates to displaying a unified user interface with a tabbed interface, wherein upcoming media content items from multiple content providers can be displayed in one of the tabbed interfaces. Background Technology
[0002] Media display devices are used to stream various media content (e.g., television programs, movies, live broadcasts, personal videos, etc.) via one or more communication networks. Media display devices include various connected display devices, such as mobile phones, set-top boxes, or connected television devices. Connected television devices are typically controlled via a remote control interface, which can be displayed directly on the media display device or separately on a second-screen mobile device (e.g., a tablet, laptop, or mobile phone). Users can browse a list of content items and search for media content on the user interface displayed on the television device, while controlling playback of media content via a dedicated remote device or a second-screen mobile device (e.g., a tablet, laptop, or mobile phone). However, the list of content items is typically organized based on a media player application configured as the content items in the playlist.
[0003] In addition, when users consume media content using these media player applications, they may be aware of the upcoming release of the media content, but usually they need to use a specific media player application to search for the upcoming release of media content that is only available from the content provider associated with that specific media player application.
[0004] Therefore, it is desirable to provide new mechanisms for a unified user interface that provides knowledge-based media content recommendations and presents upcoming media content for connected TV devices. Summary of the Invention
[0005] Based on various implementation methods of the disclosed topics, networked television devices are provided that offer a unified user interface for knowledge-based media content recommendation and presentation of upcoming media content.
[0006] The subject of this disclosure is to present a unified user interface with content-based media recommendations on networked television (TV) devices (sometimes referred to as smart TVs). The unified user interface can be configured to display multiple media content recommendations selected for a particular user, based at least in part on knowledge of that user's interests and activities (e.g., user search queries, search results, previous viewing history, purchase history, app usage history, app installation history, user actions on the networked TV device, user physical activity, etc.). In some implementations, media content recommendations can be organized into multiple clusters based on one or more categories, such as: content type (e.g., "action movies"), viewing history (e.g., "because you watched movie ABC"), and release time (e.g., "trending"). In some implementations, media content from different content sources (e.g., action movies from two different streaming services and broadcast television channels) can be recommended within the same cluster. In some implementations, the unified user interface may include a tabbed interface, wherein one of the tabbed interfaces includes upcoming media content that is organized into multiple clusters based on one or more categories, such as: release time (e.g., “this week”, “next week”, “next month”, etc.), user actions and user application interactions (e.g., “My upcoming” content items), media playback application usage (e.g., upcoming “from app ABC” items), etc.
[0007] It should be noted that the tabbed interface can present a media recommendation stream comprising an ordered set of upcoming media content items, where upcoming media content items in the recommendation stream can be selected from different content sources based on user activity data with a unified user interface, each of multiple media player applications, and each of multiple user applications. It should also be noted that the tabbed interface can include multiple clusters, where each cluster can include upcoming content items from multiple content sources.
[0008] In some implementations, the unified user interface may include a focused area (e.g., a highlighted area of the user interface) configured to sequentially display a series of media content items (e.g., advertisements, movie trailers, product images) to promote media content items, products, or events. In some implementations, a notification of upcoming media content items that have become available may be displayed within the focused area.
[0009] In some implementations, users can initiate playback of content items from the unified user interface by selecting an icon or thumbnail corresponding to the content item. In some implementations, playback of media content items selected from the unified user interface can be handled by a dedicated application associated with a specific media streaming service or broadcast channel, a wired or over-the-air (OTA) tuner, a web browser, or an internal projection application associated with a television connected to the display user interface. In some implementations, playback of content items is handled collaboratively by the media player application and the local content projection application, particularly when playback occurs in a restricted mode not supported by the media player application (e.g., in age-restricted system environments, such as a media player interface tailored for children). In some implementations where the unified user interface provides both restricted and unrestricted modes and the media player application only supports the unrestricted mode, the media player application plays media content when the user interface is in unrestricted mode, while the local projection application plays media content items when the system is in restricted mode.
[0010] In implementations where the content item is an upcoming media content item, selecting an icon, thumbnail, or tile corresponding to the upcoming media content item can present the user with an options interface that includes options such as presenting a notification to the user's account in a unified user interface when the upcoming media content item becomes available from the content provider (e.g., overlay notification, notification in a focused area, etc.), or removing the upcoming media content item from being recommended to the user's account within a specific cluster, etc.
[0011] In various implementations, the unified user interface is coupled to a server system that hosts a virtual user domain, which includes user accounts associated with users of the user interface. Hardware devices and software applications are integrated with each other via user accounts in the virtual user domain. In some implementations, user accounts are associated with networked television devices, and a unified media application is configured to present the unified user interface on the television device. User accounts may also be associated with one or more home appliances (e.g., cameras, doorbells, and / or hazard detectors), one or more media player devices (e.g., set-top boxes and / or associated television devices), one or more auxiliary devices (e.g., speaker assistants and / or display assistants), and their corresponding home security, media player, and auxiliary applications. User accounts may also be associated with general user applications, such as email applications, social media applications, mapping applications, and online retailer applications.
[0012] In some implementations, and only to the extent approved by the user, the server system learns the user's interests and activities from information in various application reports associated with the user's account, and generates targeted media content recommendations for the user based on that information. These recommendations are displayed on a unified user interface of a networked television device communicatively coupled to the server system, third-party content providers, electronic program guide (EPG) providers, and advertising (ad) providers via one or more communication networks.
[0013] According to some embodiments of the disclosed subject matter, a content-based program presentation method is provided, the method comprising: at a networked television device having one or more processors and memory, the memory storing instructions for execution by the one or more processors, wherein the television device is linked to a user account in a virtual user domain hosted by a server system; executing a unified television application to display a unified user interface, wherein the user account is associated with the unified user interface, multiple media player applications executing on the networked television device, and multiple user applications executing on the networked television device; obtaining a media recommendation stream from the server system, the media recommendation stream comprising an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items, wherein for each optional information item, the media recommendation stream comprises a corresponding command to be executed in response to a user selection of the corresponding optional information item at the networked television device, and wherein, based on user activity data with a unified user interface, multiple media player applications, and multiple user applications, the method is further defined. Each of the media player applications and each of the multiple user applications selects upcoming media content items from the media recommendation stream; displays a unified user interface with multiple tabbed interfaces, wherein the multiple tabbed interfaces include tabbed interfaces with multiple clusters, each cluster including a subset of upcoming media content items in the media recommendation stream, and wherein the multiple clusters include a first cluster that simultaneously displays at least a first optional information item associated with a first content provider and a second optional information item associated with a second content provider different from the first content provider; in response to a first user interaction with the first optional information item in the tabbed interface, displays information about a first upcoming media content item provided by the first content provider; and in response to a second user interaction with the second optional information item in the tabbed interface, displays information about a second upcoming media content item provided by a second content provider different from the first content provider.
[0014] In some implementations, the first user interaction includes using a remote control to position a highlighted area on a tile, the tile corresponding to first selectable information presented within a first cluster of a tabbed interface.
[0015] In some implementations, the method further includes a user selection to receive first optional information and, in response to the user selection to receive the first optional information, displaying an options interface, the options interface including an option to present a notification to a user of a user account in a unified user interface when a first upcoming media content item becomes available from a first content provider, wherein, when the notification is selected, a media player application corresponding to the first content provider is launched for playback of the first upcoming media content item that has become available.
[0016] In some implementations, the options interface also includes an option to remove first optional information from the recommended list within the first cluster.
[0017] In some implementations, the options interface also includes an option to add a first upcoming media content item, represented by a first optional information, to a queue of media content items for playback on a networked television device.
[0018] In some implementations, the method further includes receiving a user selection of first optional information and, in response to receiving the user selection of the first optional information, launching a media player application on a networked television device corresponding to the first content provider to display additional information about a first upcoming media content item.
[0019] In some implementations, user activity data associated with user applications from multiple user applications further includes: receiving a search query; presenting search results in response to the search query, wherein the search results include a third upcoming media content item, wherein the third upcoming media content item is presented simultaneously with an option to add the third upcoming media content item to the tabbed interface; and updating the unified user interface to present a second cluster on the tabbed interface in response to a user selection of the option to add the third upcoming media content item to the tabbed interface, wherein the second cluster includes the third upcoming media content item.
[0020] In some implementations, user activity data associated with user applications from multiple user applications further includes: receiving user interactions with upcoming media content items associated with a content provider in a unified user interface, wherein the content provider is associated with a media player application installed on a networked TV device; and updating the unified user interface to present a second cluster on a tabbed interface, wherein the second cluster includes additional upcoming media content items corresponding to the content provider, wherein a user selection of one of the additional upcoming media content items in the second cluster causes the media player application to be launched on the networked TV device.
[0021] In some implementations, the multiple tabbed interfaces in the unified user interface include user-configurable tabbed interfaces, and wherein user activity data associated with the unified user interface further includes: receiving user interactions with upcoming media content items associated with a content provider in the user-configurable tabbed interfaces of the unified user interface; and updating the unified user interface to present a second cluster on the tabbed interfaces, wherein the second cluster includes upcoming media content items from the user-configurable tabbed interfaces of the unified user interface.
[0022] In some implementations, the unified user interface also includes displaying one or more focused items in the focused area simultaneously with multiple clusters displaying tabbed interfaces in the non-focused area, wherein the one or more focused items include multiple optional focused items displayed in the focused area according to a time series, and wherein a notification to the user of the user account when a first upcoming media content item becomes available from a first content provider is presented in the focused area.
[0023] According to some embodiments of the disclosed subject matter, a networked television device is provided, wherein the networked television device is linked to a user account in a virtual user domain hosted by a server system. The networked television device includes one or more processors and a memory storing instructions thereon. One or more programs include instructions that, when executed by one or more processors, cause the processors to perform the following operations: executing a unified television application to display a unified user interface, wherein the user account is associated with the unified user interface, multiple media player applications executing on the networked television device, and multiple user applications executing on the networked television device; obtaining a media recommendation stream from the server system, the media recommendation stream including an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items, wherein, for each optional information item, the media recommendation stream includes a corresponding command to be executed in response to a user selection of the corresponding optional information item at the networked television device, and wherein, based on a unified user interface... User activity data, each of multiple media player applications, and each of multiple user applications are used to select upcoming media content items in the media recommendation stream; a unified user interface with multiple tabbed interfaces is displayed, wherein the multiple tabbed interfaces include tabbed interfaces with multiple clusters, each cluster including a subset of upcoming media content items in the media recommendation stream, and wherein the multiple clusters include a first cluster that simultaneously displays at least a first optional information item associated with a first content provider and a second optional information item associated with a second content provider different from the first content provider; in response to a first user interaction with the first optional information item in the tabbed interface, information on a first upcoming media content item provided by the first content provider is displayed; and in response to a second user interaction with the second optional information item in the tabbed interface, information on a second upcoming media content item provided by a second content provider different from the first content provider is displayed.
[0024] According to some embodiments of the disclosed subject matter, a non-transitory computer-readable medium is provided containing computer-executable instructions that, when executed by a processor of a networked television device, cause the processor to perform a content-based program presentation method. The method includes: executing a unified television application to display a unified user interface, wherein a user account is associated with the unified user interface, multiple media player applications running on the networked television device, and multiple user applications running on the networked television device; obtaining a media recommendation stream from a server system, the media recommendation stream comprising an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items, wherein for each optional information item, the media recommendation stream includes a corresponding command to be executed in response to a user selection of the corresponding optional information item at the networked television device, and wherein, based on user activity data with a unified user interface, each of the multiple media player applications... The user can select upcoming media content items from a media recommendation stream from each of multiple user applications; display a unified user interface with multiple tabbed interfaces, wherein the multiple tabbed interfaces include tabbed interfaces with multiple clusters, each cluster including a subset of upcoming media content items from the media recommendation stream, and wherein the multiple clusters include a first cluster that simultaneously displays at least a first optional information item associated with a first content provider and a second optional information item associated with a second content provider different from the first content provider; in response to a first user interaction with the first optional information item in the tabbed interface, display information about a first upcoming media content item provided by the first content provider; and in response to a second user interaction with the second optional information item in the tabbed interface, display information about a second upcoming media content item provided by a second content provider different from the first content provider.
[0025] According to some embodiments of the disclosed subject matter, a networked television device is provided, wherein the networked television device is linked to a user account in a virtual user domain hosted by a server system. The networked television device includes: means for executing a unified television application to display a unified user interface, wherein the user account is associated with the unified user interface, a plurality of media player applications executing on the networked television device, and a plurality of user applications executing on the networked television device; means for obtaining a media recommendation stream from the server system, the media recommendation stream comprising an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items, wherein for each optional information item, the media recommendation stream includes a corresponding command to be executed in response to a user selection of the corresponding optional information item at the networked television device, and wherein the command is based on user activity data with a unified user interface, each of the plurality of media player applications, and each of the plurality of user applications. The device includes: means for selecting upcoming media content items in a media recommendation stream; means for displaying a unified user interface with multiple tabbed interfaces, wherein the multiple tabbed interfaces include tabbed interfaces with multiple clusters, each cluster including a subset of upcoming media content items in the media recommendation stream, and wherein the multiple clusters include a first cluster that simultaneously displays at least a first optional information item associated with a first content provider and a second optional information item associated with a second content provider different from the first content provider; means for displaying information about a first upcoming media content item provided by the first content provider in response to a first user interaction with the first optional information item in the tabbed interface; and means for displaying information about a second upcoming media content item provided by a second content provider different from the first content provider in response to a second user interaction with the second optional information item in the tabbed interface. Attached Figure Description
[0026] The various purposes, features and advantages of the disclosed subject matter can be more fully understood when considered in conjunction with the following figures and with reference to the following detailed description of the subject matter, in which similar reference numerals identify similar elements.
[0027] Figure 1 This is an example media environment based on some implementations of the disclosed subject matter, in which networked television devices, server systems, and third-party content sources interact with each other via one or more communication networks.
[0028] Figure 2 This is an example operating environment based on some implementations of the disclosed subject matter, in which a server system can provide knowledge-based media content recommendations to networked television devices.
[0029] Figure 3This is an example unified user interface for display on networked television devices, based on some implementations of the disclosed subject matter.
[0030] Figure 4 This is an example flowchart of a method for providing knowledge-based media content recommendations to networked television devices according to some implementations of the disclosed subject matter.
[0031] Figure 5 This is an example flowchart of a method for presenting program information on a networked television device according to some embodiments of the disclosed subject matter.
[0032] Figure 6A and 6B These are two example media content item pages displayed on a networked television device, based on some implementations of the disclosed subject matter.
[0033] Figure 7 This is an example operating environment, based on some implementations of the disclosed subject matter, in which a unified TV application and a media player application collaborate to play media content items on a networked TV device.
[0034] Figure 8 These are example sequences of user interfaces that are sequentially displayed on a networked television device in response to user actions on a remote control device coupled to the networked television device, according to some implementations of the disclosed subject matter.
[0035] Figure 9 This is an example operating environment based on some implementations of the disclosed subject matter, in which the unified TV application, media player application, and content casting application of a networked TV device collaboratively enable playback of media content items.
[0036] Figure 10A This is an example unified user interface displayed in a restricted mode on a networked TV device, based on some implementations of the disclosed subject matter.
[0037] Figure 10B and 10C These are two example sequences of user interfaces that are sequentially displayed on a networked television device in response to user actions on a remote control device coupled to the networked television device, according to some embodiments of the disclosed subject matter.
[0038] Figure 11 This is an example flowchart of a method for presenting selected media content provided by a media player application on a networked television device, according to some embodiments of the disclosed subject matter.
[0039] Figure 12This is an example operating environment based on some implementations of the disclosed subject matter, in which focused items (also called tiles) provided by a recommendation engine, one or more advertising (ad) providers, and commoditization modules are mixed for display on a networked television device.
[0040] Figure 13 This is an example flowchart of a method for mixing focused content (including VAST-based advertising) on a networked television device according to some embodiments of the disclosed subject matter.
[0041] Figure 14A This is a block diagram illustrating a server system for a media environment based on some implementations of the disclosed subject matter.
[0042] Figure 14B This is an example device and application registry of a server system according to some embodiments of the disclosed subject matter, which stores information about one or more user accounts managed by the server system, as well as information about user devices and applications associated with each of the one or more user accounts.
[0043] Figure 15 This is a block diagram illustrating an example networked television device configured to display a unified user interface and media content provided by a media player application, according to some embodiments of the disclosed subject matter.
[0044] Figure 16 This is an example flowchart of a method for providing knowledge-based media content recommendations, including upcoming media content, to networked television devices according to some embodiments of the disclosed subject matter.
[0045] Figure 17 This is an example flowchart of a method for presenting program information associated with upcoming media content on a networked television device, based on some implementations of the disclosed subject matter.
[0046] Figure 18 This is an example unified user interface for display on a networked television device, based on some implementations of the disclosed subject matter, which includes a tabbed interface for upcoming media content items.
[0047] Figure 19 and Figure 20 This is an example unified user interface for display on a networked television device according to some embodiments of the disclosed subject matter. The example unified user interface includes a tabbed interface for upcoming media content items, wherein the user has already interacted with information items within a cluster of upcoming media content items.
[0048] Figure 21This is an example unified user interface for display on a networked television device, based on some embodiments of the disclosed subject matter, which includes a search interface for media content items.
[0049] Figure 22 and 23 This is an example unified user interface for display on a networked television device according to some embodiments of the disclosed subject matter, which includes user interface elements for adding search results to upcoming media content items in a tabbed interface.
[0050] Figure 24 This is an example unified user interface for display on a networked television device according to some embodiments of the disclosed subject matter, which includes a tabbed interface for recommending media content items that can be presented in response to the execution of a unified television application.
[0051] Figure 25 This is an example unified user interface for display on a networked television device according to some embodiments of the disclosed subject matter, which includes options for adding recommended media content from a tabbed interface to an upcoming media content item.
[0052] Figure 26 This is an example unified user interface for display on a networked television device, based on some implementations of the disclosed subject matter, which includes a tabbed interface for upcoming media content items, wherein clusters of upcoming media content items selected by the user and clusters of upcoming media content items from media player applications that the user has already interacted with can be presented.
[0053] Figure 27 This is an example unified user interface for display on a networked television device according to some embodiments of the disclosed subject matter. The example unified user interface includes a tabbed interface for upcoming media content items, wherein the user has selected information items within a cluster of upcoming media content items.
[0054] Figure 28 and 29 This is an example unified user interface for display on a networked television device according to some embodiments of the disclosed subject matter. The example unified user interface includes a notification interface related to upcoming media content items that have become available for playback on the networked television device. Detailed Implementation
[0055] Based on various implementations of the disclosed topics, networked television devices are provided, featuring a unified user interface for knowledge-based media content recommendation and presentation of upcoming media content.
[0056] In various implementations, the media environment includes a networked television device (also known as a smart television device) having one or more processors and memory storing instructions for execution by the one or more processors. The networked television device is linked to a user account in a virtual user domain hosted by a server system. The networked television device executes a unified television application to display a unified user interface on which media content items provided by various media content providers are selected and displayed for the user of the networked television device. In some implementations, the networked television device is controlled by a dedicated remote control device or a client device having a remote control application for playing media content items for the user. In some implementations, the dedicated remote control device is positioned near the television device. In some implementations, the dedicated remote control device or the client device with the remote control application is not physically located near the television device but is associated with a user account maintained at the server system of the media environment.
[0057] When a connected TV device executes the Unified TV application, it obtains a media recommendation stream from a server system. The media recommendation stream comprises an ordered sequence of optional information items corresponding to an ordered set of unique media content items or programs. Optional information items in the media recommendation stream are identified for a specific user based at least in part on knowledge of the connected TV device's user (e.g., the user's interests and activities). Specifically, the user account associated with the Unified TV application is also associated with multiple media player applications and multiple user applications (e.g., search engines, map applications). Activity data from these applications is stored in association with the user account and used to calculate the user's multidimensional unified user activity characteristics (also known as a knowledge graph). Based on the user activity characteristics, an ordered sequence of optional information items is determined from program information associated with the multiple media player applications and recommended to the user via the Unified TV application.
[0058] In a more specific example, when a connected TV device executes the Unified TV application, the Unified TV application can obtain a media recommendation stream of upcoming media content items that are currently not playable on the connected TV device from a server system. The media recommendation stream can include an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items or programs. Optional information items in the media recommendation stream can be identified for a specific user, at least in part, based on knowledge of the connected TV device's user (e.g., the user's interests and activities). Specifically, the user account associated with the Unified TV application can also be associated with multiple media player applications and multiple user applications (e.g., search engines, map applications). Activity data from these applications can be stored in association with the user account and can be used to calculate the user's multidimensional unified user activity characteristics (also known as a knowledge graph). Based on the user activity characteristics, an ordered sequence of optional information items is determined from program information associated with multiple media player applications and recommended to the user via the Unified TV application.
[0059] An ordered sequence of optional information items is displayed on the unified user interface of the networked TV device. For each optional information item, the media recommendation stream includes a corresponding command to be executed in response to the user's selection of the corresponding optional information item at the networked TV device. Optional information items are organized into clusters and arranged without reference to their content providers. That is, two information items associated with media content items provided by different content providers can be placed adjacent to each other, allowing the unified user interface to focus on the content and be invisible to content providers on its surface.
[0060] In addition to optional information items, the unified user interface can optionally display multiple focus items sequentially in the focus area according to chronological order; that is, each focus item occupies the entire focus area sequentially. The focus area can be located in the upper half of the unified user interface. Each focus item is associated with a corresponding focus item provider selected from the commoditization module, advertisers, and media recommendation engine. Focus items provided by the commoditization module of the server system optionally correspond to media content items provided by TVOD content providers and requiring payment for viewing. In some implementations, the focus item is an advertising item provided by an advertiser, and the advertising item conforms to a customized Video Ad Service Template (VAST). Specifically, the television device sends a request for a focus item to the advertiser, which includes information about predefined user interface elements of the focus area. The advertising item is aggregated from multiple media content items provided by the advertiser based on the information of the predefined user interface elements. In some implementations, notifications related to upcoming media content items that have become available for playback can be presented in the focus area.
[0061] In some implementations, the Unified TV app has a restricted mode, where application content selection criteria restrict media content provided via standard media content apps for playback on the unified user interface. For example, the content selection criteria may be related to age-based content ratings, and the restricted mode may be defined as child-friendly. In restricted mode, the Unified TV app may optionally determine whether the standard media content app is operating in restricted mode. Based on the determination that the standard media content app is operating in restricted mode, media content is displayed on the unified user interface via the standard media content app. Alternatively, based on the determination that a third-party media content app is not operating in restricted mode, media content is displayed on the unified user interface via a local content casting app different from the standard media content app.
[0062] Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the various embodiments described. However, it will be apparent to those skilled in the art that the various embodiments described can be practiced without these specific details. In other instances, well-known methods, processes, components, circuits, and networks have not been described in detail to avoid unnecessarily obscuring the corresponding aspects of the embodiments.
[0063] Figure 1 This is an example media environment 100 according to some implementations, in which networked television devices 102, server system 104, and third-party content sources 106 to 110 interact with each other via one or more communication networks 112. Media environment 100 corresponds to a virtual user domain created and hosted by server system 104, and the virtual user domain includes multiple user accounts. Third-party content sources 106 to 110 include advertising sources 106, EPG sources 108, and media content sources 110. For each user account, server system 104 is coupled to third-party content sources 106 to 110 and one or more media devices 102 and 116 to 126, and is configured to recommend and stream media content for users to view via the corresponding user account.
[0064] Specifically, one or more media devices associated with a user and a user account are arranged in media environment 100 to provide the user with media content stored at and streamed from a remote content source. The remote content source may optionally be a third-party media content source 110 or an internal media source hosted by server system 104. In some embodiments, one or more media devices include a networked television device 102 that directly streams media content from a remote content source, or an embedded projection unit configured to stream media content for display to its viewers. The networked television device 102 is communicatively coupled to a dedicated remote control device 114 and / or a client device with a remote control application. The dedicated remote control device 114 may be located near the television device 102 and configured to communicate with the television device 102 using digitally coded pulses of infrared signals. Alternatively, in some cases, the dedicated remote control device 114 is configured to communicate with the television device 102 via a communication network 112 (i.e., via a local area network and / or a wide area network) and does not need to be physically close to the television device 102.
[0065] The networked television device 102 includes one or more processors and memory storing instructions for execution by the one or more processors. The instructions stored on the networked television device 102 include a unified television application, a local content casting application, and one or more media player applications associated with third-party content sources 106 to 110 and / or internal media sources associated with server system 104. These applications are linked to user accounts in a virtual user domain of media environment 100.
[0066] Alternatively, in some embodiments, the media devices disposed in the media environment 100 include a display device 116 that directly outputs media content to a viewer and a projection device 118 coupled to the display device 116 and configured to stream media content to the display device 116. Examples of the display device 116 include, but are not limited to, television (TV) display devices and music players. Examples of the projection device 118 include, but are not limited to, set-top boxes (STBs), DVD players, and television boxes. Figure 1 In the example shown, display device 116 includes a television display hardwired to a DVD player or set-top box 118. Conversely, in some embodiments, media devices arranged in media environment 100 include a computer screen 120A that outputs media content to a viewer and a desktop computer 120B that streams media content to the computer screen 120B. In some embodiments, media devices arranged in media environment 100 include mobile devices, such as a mobile phone 122, a tablet computer 124, and a laptop computer 126. Each of media devices 118 to 126 includes one or more media player applications configured to receive and play media content items provided by third-party content sources 106 to 110 or internal media sources associated with server system 104.
[0067] Server system 104 includes a Unified Media Platform (UMP) 128 configured to manage media content recommendations and streaming to one or more media devices in media environment 100. UMP 128 is configured to receive multidimensional unified user activity characteristics associated with a user account from knowledge graph engine 130, as well as program information or content items of programs provided by media content sources 110, and generate personalized media content recommendations for the user account. The unified user activity characteristics associated with the user account are obtained from multiple information sources 132, such as search engines, mapping applications, and online retailers associated with the user account, each providing activity data related to the user account's activity via a corresponding software program or application. Optionally, the media content recommendations generated by UMP 128 are presented on networked television device 102 via server-side television application 134, and server-side television application 134 enables the display of media content on the unified television application of television device 102 in response to user selections from the media content recommendations. In addition, UMP 128 can also be used as a centralized media content management module, which is configured to provide media content recommendations to other media devices 118 to 126 in addition to television device 102.
[0068] In some implementations, activity data associated with a user account is collected from the TV application 134 and the projection service module 136 (which are therefore part of the information source 132) and returned to the knowledge graph engine 130 to update the unified user activity characteristics and media content recommendations associated with the user account.
[0069] In some implementations, the UMP 128 also includes a media search engine (e.g., Figure 2 The engine 222 is configured to receive search queries from the server-side TV application 134 or the projection service module 136 and identify one or more media content items from the program information of the programs or content items provided by the media content source 110.
[0070] It is worth noting that the user accounts in the virtual user domain hosted by server system 104 are also associated with one or more other types of devices, such as smart, multi-sensor, networked assistive devices 138 and home appliances 140 installed in the media environment 100 associated with the user of the networked television device 102. Examples of assistive devices 138 include speaker assistive devices 142 and display assistive devices 144. Speaker assistive devices 142 are capable of collecting audio input, recognizing user commands from the audio input, and performing operations in response to user commands (e.g., playing music, answering questions). Display assistive devices 144 are capable of collecting audio and / or video input, recognizing user commands from the audio and / or video input, and performing operations in response to user commands (e.g., playing music, displaying images or video clips, answering questions). Examples of home appliances 140 include one or more of the following: smart, multi-sensoring and networked—hazard detectors 146, camera systems 148, thermostats, entry interface devices (e.g., smart doorbells and “smart locks”), alarm systems, microphone devices, wall switches, wall plug interfaces, and appliances (e.g., refrigerators, stoves, ovens, televisions, washing machines, dryers, lighting fixtures, audio systems, intercom systems, garage door openers, floor fans, ceiling fans, wall-mounted air conditioners, pool heaters, irrigation systems, security systems, space heaters, window air conditioning units, and electrically powered ducted vents).
[0071] Each of the auxiliary device 138 and home device 140 may optionally be managed by a unified home device application or a dedicated user application, and linked to a user account in the virtual domain via a unified TV application for networked TV devices. Activity data collected by the knowledge graph engine 130 may also include data collected by a subset of the auxiliary device 138 and home device 140, thereby allowing media content recommendations provided to the user to reflect this activity data collected directly from the physical surroundings associated with the media environment 100.
[0072] In some implementations, server system 104 includes a device and application registry 150 configured to store information about one or more user accounts managed by server system 104, as well as information about user devices and applications associated with each of the one or more user accounts. For example, device and application registry 150 stores information about networked television device 102, remote control device 114, media devices 116 to 126, auxiliary device 138, and home device 140, as well as corresponding unified television application, remote control application, media player application, unified home device application, and dedicated user applications associated with auxiliary device 138 and home device 140. Optionally, these media devices, auxiliary devices, and home devices associated with the same user account are distributed across different geographical regions. Optionally, these devices are located in the same physical location. Each media, auxiliary, or home device communicates with another device or server system 104 using one or more communication networks 112. The communication network 112 used can be one or more networks with one or more types of topologies, including but not limited to the Internet, intranet, local area network (LAN), cellular network, Ethernet, storage area network (SAN), telephone network, Bluetooth personal area network (PAN), etc. In some embodiments, two or more devices in a subnetwork are coupled via a wired connection, while at least some devices in the same subnetwork are coupled via a local radio communication network (e.g., ZigBee, Z-Wave, Insteon, Bluetooth, Wi-Fi, and other radio communication networks).
[0073] Figure 2This is an example operating environment 200 according to some implementations, in which server system 104 provides knowledge-based media content recommendations to networked television device 102. In example operating environment 200, server system 104 includes multiple information sources 132, knowledge graph engine 130, UMP 128, and server-side television application 134. Server system 104 hosts virtual user domains that include user accounts associated with server-side television application 134 and unified television application 202 implemented at networked television device 102. User accounts are also associated with multiple media player applications 204 and multiple user applications (e.g., search engine 206). Server system 104 stores activity data for each of unified television application 202, media player application 204, and user applications. Knowledge graph engine 130 of server system 104 calculates multidimensional unified user activity characteristics 208 (e.g., regarding user preferences or affinity) based on the stored activity data and obtains program information associated with multiple media player applications 204, generating deduplicated program information 210 for multiple unique programs (also referred to as media content items). UMP128 includes a recommendation engine 212 configured to compare user activity characteristics 208 with program information 210 of multiple unique programs to identify an ordered subset 214 of unique programs to be recommended to the user via the Unified TV application 202.
[0074] In one example, knowledge graph engine 130 receives multiple search queries about "Star Wars" from search engine 206 and determines that a user associated with that user account is interested in "Star Wars". These multiple unique programs associated with program information are ranked in terms of the user's interests, preferences, or affinity (i.e., represented by uniform user activity characteristic 208). A certain number of the top-ranked unique programs are selected and categorized into clusters. Given the user's interest in "Star Wars" indicated by the search queries, the top-ranked unique programs include one or more media content items related to "Star Wars", and the clusters include clusters related to "Star Wars", such as "science fiction movies like Star Wars".
[0075] An ordered subset 214 of unique programs identified by recommendation engine 212 is represented by an ordered sequence of information items, which is provided to server-side TV application 134 and made available for display via unified TV application 202 of networked TV device 102. In some cases, the activity data used by knowledge graph engine 130 and the resulting unified user activity characteristics 208 are constantly changing. The ordered subset 214 of unique programs can be identified dynamically. For example, the ordered subset 214 of unique programs is updated periodically or in response to requests from users of networked TV device 102. In some cases, each unique program in the ordered subset 214 has a usage period determined based on the corresponding content type of the unique program, and must be removed from the recommended ordered successor programs after the usage period expires. In some implementations, the unified user activity characteristics 208 can change the time of day and the day of the week, and so can the ordered subset 214 of unique programs recommended via unified TV application 202.
[0076] Multiple user applications act as multiple information sources 132 to provide activity data of users of the television device 102, and at least include an internet search engine 206. A server system 104 stores and provides search queries and search results from multiple search operations performed by the internet search engine 206 from user accounts to a knowledge graph engine 130. Furthermore, in some embodiments, the server system 104 stores viewing information associated with a subset or all of the user accounts of the media player application 204, and purchase information associated with a subset of the user accounts of user applications (e.g., online retailer applications). This viewing and purchase information is provided to the knowledge graph engine 130 along with the search queries and search results. In some embodiments, the multiple user applications include a voice or video assistance application 218 associated with a speaker or display auxiliary device 142 or 144. In some embodiments, the multiple user applications include a unified home appliance application and / or a dedicated home appliance application 220 associated with one or more home appliances 140. Activity data collected by these assistance applications 218 and home appliance applications 220 is also stored and provided to the knowledge graph engine 130.
[0077] Optionally, one of the media player applications 204 is provided by the server system 104 itself. Optionally, the media player application 204 is provided by a third-party media content source 110 that is different from and / or located away from the server system 104. In the example, the virtual user domain is associated with a Google user account (e.g., abc@gmail.com). The media player application 204 includes YouTube provided by Google and other media player applications that are not provided by Google and are independent of Google's hosting (e.g., Netflix, Amazon Prime, Hulu).
[0078] In some implementations, program information associated with multiple media player applications 204 includes one or more of the following: schedule information, brief summaries of episodes, actor information, rating information, and comments on current and scheduled programs available or to be available on each media player application. The program information may optionally be provided to the server system 104 in a program catalog by each of the third-party media content sources 110 associated with the multiple media player applications 204. Optionally, the program information may be provided to the server system 104 by EPG source 108. Alternatively, in some implementations, the program information associated with the multiple media player applications 204 may include public media information downloaded from a public database independent of user accounts. The program information associated with the media player applications may be provided to the server system 104 independently of whether the user account associated with the television device 102 and the unified television application 202 has subscribed to the media player application and has access to media content provided via the media player application.
[0079] In some implementations, program information about the same media content item provided by different media content sources 110 is different and can vary to different levels, thus requiring deduplication of program information associated with multiple media player applications. Specifically, in some implementations, a first media content item is provided by a first media player application and associated with first program information. A second media content item is provided by a second media player application and associated with second program information in a second media player application. The second program information is different from the first program information. The knowledge graph engine 130 identifies the similarity level between the first and second program information and determines that the similarity level exceeds a similarity threshold. Based on this determination, the knowledge graph engine 130 deduplicates and aggregates the first program information of the first media content item and the second program information in the second media content item, and determines that one of a plurality of unique programs is associated with both the first and second media content items. That is, the first and second media content items provided by two different media player applications correspond to the same unique program or media content item. Furthermore, in some implementations, the knowledge graph engine 130 identifies the similarity level between the first program information and the second program information by identifying a first keyword from the first program information and a second keyword from the second program information. A semantic comparison is performed on the first and second keywords to identify the similarity level between the first and second program information items. For example, two program information items may be identical but cite different keywords with similar semantics, such as "police" and "inspector." These two program information items correspond to a relatively high similarity level, above a similarity threshold.
[0080] In some implementations, in addition to deduplication, program information associated with multiple media player applications is processed to calculate program characteristics of one of the unique programs. The multidimensional unified user activity characteristics are then compared with the calculated program characteristics to obtain a consistency score. Recommendation engine 212 is configured to determine whether the consistency score exceeds a consistency threshold, and when the consistency score exceeds the consistency threshold, identify one of the unique programs to be recommended to the user via the unified TV application. Alternatively, in some implementations, to identify each of the ordered subsets of unique programs, recommendation engine 212 identifies one or more keywords based on the multidimensional unified user activity characteristics and searches for one or more keywords in the deduplicated program information of multiple unique programs to identify the corresponding unique program in the ordered subset of unique programs.
[0081] In some implementations, recommendation engine 212 receives authorization information for a subset of multiple media player applications. For each of the ordered subsets of unique programs, recommendation engine 212 determines, based on the authorization information, that the corresponding unique program corresponds to a media player application that the user of the networked television device has access to. Depending on the authorization information, a user may have access to the corresponding unique program because the user has subscribed to the corresponding media player application, or because the corresponding unique program can be viewed for free with or without registration. The corresponding unique programs that can be viewed for free include media content that is freely available over the air (e.g., via feeds delivered through broadcast services or IPTV), as well as media content that becomes available due to regional regulations or authorizations.
[0082] In other words, the personal preferences indicated by the multidimensional unified user activity characteristics are used to select a unique set of programs from the unique programs offered by media content source 110 and to rank the selected unique program group. The selected unique set of programs is further filtered based on authorization information indicating whether the user account has authorization (e.g., access rights) to the media content offered by media content source 110 via the corresponding media player application 204. This authorization information associated with the media player application may optionally be entered by the user of the unified TV application during the initial application personalization process or execution phase of the unified TV application 202. Optionally, this authorization information associated with the media player application may be automatically extracted from the media player application.
[0083] In some implementations, UMP 128 also includes a media search engine 222 configured to receive search queries from server-side TV application 134 and identify one or more media content items from program information 210 of programs or content items provided via media player application 204.
[0084] Server system 104 has one or more processors and memory storing instructions for execution by the one or more processors. In some embodiments, server system 104 includes a single server computer configured to implement the functions of knowledge graph engine 130, recommendation engine 212, media search engine 222, and server-side television application 134. Alternatively, in some embodiments, server system 104 includes two or more separate server computers, each configured to implement the functions of one or more of the knowledge graph engine 130, recommendation engine 212, media search engine 222, and server-side television application 134.
[0085] Figure 3 This is an example unified user interface 300 for display on a networked television device 102, according to some implementations. A unified television application 202 is executed locally on the networked television device 102 to display the unified user interface 300. (See above reference...) Figure 2 As explained, server system 104 identifies an ordered subset 214 of unique programs based on user activity characteristics 208 and program information 210 of multiple unique programs. Unified TV application 202 obtains a media recommendation stream from server system 104, which includes an ordered sequence of optional information items 302 to 332 corresponding to the identified ordered subset 214 of unique media content items or programs. For each optional information item, the media recommendation stream includes a corresponding command to be executed in response to a user selection of the corresponding optional information item displayed on networked TV device 102.
[0086] In some implementations, the corresponding ordered sequences of optional information items are categorized into an ordered list of clusters 334 to 340. That is, multiple clusters 334 to 340 are created for display on the unified user interface 300 and physically arranged according to a predefined clustering order. Optionally, these clusters are dynamically created and arranged based on multidimensional unified user activity characteristics 208. In some implementations, the clusters recommended by the unified TV application 202 have a certain level of heterogeneity, i.e., they have more than a predetermined number of different clusters. For example, three or more different clusters must be recommended by the unified TV application 202. Alternatively, in some implementations, the clusters displayed on the unified user interface 300 have similarity scores controlled below a cluster similarity threshold between multiple adjacent clusters. This is to avoid similar clusters and information items being arranged adjacent to each other in highly related clusters. In some implementations, a benchmark is established to define a cluster similarity threshold spanning multiple adjacent clusters.
[0087] Each cluster comprises one or more information items in an ordered sequence, which are sorted into an ordered subset of information items in the corresponding cluster. For each cluster (e.g., the first cluster 338), a corresponding subset of the ordered sequence of optional information items (e.g., information items 318 to 324) is physically arranged according to a predefined order of information items determined based on the multidimensional unified user activity characteristics 208 of user accounts associated with the ordered sequence of optional information items.
[0088] Examples of clusters displayed on the unified user interface 300 include “New Releases” 334, “Play Next” 336, “Current Trends” 338, “Because You Watched Movie ABC” 340, and “Action Movies”. In another example, clusters are dedicated to a single media player application (e.g., YouTube), and the subset of information items associated with the cluster corresponds to a mix of performances, movies, and television content programs offered by the single media player application. Therefore, each cluster corresponds to a corresponding ordered sublist of information items and is defined according to one or more of the following categories: content type (e.g., “Action Movies”), viewing history (e.g., “Because You Watched Movie ABC”), release time (e.g., “Trending”), or content source (e.g., different streaming services and broadcast television channels offering action movies). Specifically, the information items in the “New Releases” cluster are determined based on one or more of the following: content type / format, content quality, recentity, popularity, seasonality, and application lifecycle, associated with the media content items or programs corresponding to the information items in “New Releases”.
[0089] In some implementations, the media content items corresponding to the information items in the "New Releases" or "Current Trends" cluster are provided by a transactional video-on-demand (TVOD) content provider, and the selection of media content items in "New Releases" or "Current Trends" is configured such that the user interface prompted to the user of television device 102 can collect payment for viewing the media content items. Optionally, this "New Releases" or "Current Trends" cluster is provided as part of an ordered sequence of information items corresponding to an ordered subset 214 of unique programs determined based on uniform user activity characteristics 208. Optionally, independent of the uniform user activity characteristics 208 for individual user accounts, the "New Releases" or "Current Trends" cluster is provided to all user accounts as a supplement to the ordered sequence of information items corresponding to the ordered subset 214 of unique programs.
[0090] In some implementations, the media content items corresponding to the information items in the "Action Movies" cluster are provided by a subscription video-on-demand (SVOD) content provider. The selection of media content items in this cluster is configured to enable a media content item page (also known as a summary page, e.g., Figure 6AThe display of media content items can be initiated on page 600 or without requesting immediate payment. Furthermore, in some implementations, the media content items corresponding to the information items in the "Play Next" cluster may optionally be provided by an SVOD or TVOD content provider. In response to selecting a media content item in the "Play Next" cluster, the television device 102 resumes displaying the media content item, thereby allowing the user of the television device 102 to have one-click access to continue watching their favorite performance or movie.
[0091] For each cluster on the unified user interface 300, a portion or all of the ordered sublist of information items is displayed based on the total number of information items in the corresponding sublist, the size of each information item, and the available display space associated with the corresponding cluster. In some implementations, each of the ordered subsets 214 of unique programs is distinct from any other unique program in the ordered subsets 214 of unique programs. Any two information items 302 to 332 displayed in the unified user interface 300 are distinct from each other. In some cases, any two information items 302 to 332 displayed in the same cluster of the unified user interface 300 are distinct from each other. Alternatively, in some cases, two information items 302 to 332 may be the same but are recommended in different clusters; for example, information item 310 associated with Downton Abbey appears in both the cluster “Play Next” 336 and the cluster “Drama”.
[0092] In some implementations, the unified user interface 300 includes application availability items 342 that differ from the clustered ordered list, along with corresponding optional information items displayed therewith. In response to a user action on availability item 342 (e.g., selection of item 342 via remote control device 114), the unified TV application 202 updates the unified user interface 300 with a page of information items, each information item representing a corresponding media player application 204. Figure 3 In some embodiments not shown, the unified user interface 300 also includes replaceable clusters of information items, each information item representing a corresponding one of a plurality of media player applications 204.
[0093] In some implementations, the unified user interface 300 includes EPG availability items 348. In response to a user action on availability item 348 (e.g., selection of item 348 via remote control device 114), the unified TV application 202 displays a unified EPG page that includes a schedule of multiple content items and programs provided by broadcast services (e.g., television, cable television, satellite, YouTube) and organized chronologically. Content items and programs are selected based at least in part on the location of the networked TV device 102. In some implementations, multiple content items and programs are also determined by comparing multidimensional unified user activity characteristics 208 with deduplicated program information corresponding to media content items and programs provided by broadcast services.
[0094] Information items 302 to 332 are provided by more than one media content source 110, but are organized and displayed on the unified user interface 300 based on the content of media content items or programs 214 recommended by the recommendation engine 212 of the server system 104 (rather than the media content sources). Specifically, each cluster displayed on the unified user interface 300 includes a subset of an ordered sequence of optional information items. The first cluster 338 includes a first optional information item 318 and a second optional information item 320. The first and second optional information items 318 and 320 of the first cluster 338 are simultaneously displayed on the unified user interface 300. In response to a first user selection of the first optional information item 318, the television device 102 displays information about a first media content item provided by a first content provider. In response to a second user selection of the second optional information item 320, the television device 102 displays information about a second media content item provided by a second content provider. The second content provider differs from the first content provider, although information about both the first and second content providers may be optionally hidden on a unified user interface 300 that displays clusters 334 to 340 and optional information items 302 to 332.
[0095] In some implementations, each of the first and second content providers is selected from: broadcast television services, broadcast satellite services, cable television services, subscription video-on-demand (SVOD) content providers, transactional video-on-demand (TVOD) content providers, advertising-based video-on-demand (AVOD) services, and replay and time-shifted content playback sources. Optionally, the first or second content provider relies on tuner-based delivery of over-the-air media content. Optionally, the first or second content provider delivers live television streams based on linear, live, or synthetic live content sources delivered via Internet Protocol Television (IPTV) or other Internet-based live streaming services. If one of information items 302 to 332 corresponds to a broadcast television service (e.g., NBC, ABC, ESPN), then, depending on the geographical restrictions associated with the broadcast television service, it is permissible to display a unique broadcast program corresponding to one of information items 302 to 332 at the location of the television device 102.
[0096] Note that the unified TV application 202 is associated with a user account in a virtual user domain hosted by server system 104. In some implementations, a first content provider is associated with a first media player application, and the first media player application may optionally be associated with a user account in a virtual user domain hosted by server system 104. In some implementations, a second content provider is associated with a second media player application, and the second media player application may optionally be associated with a user account in a virtual user domain hosted by server system 104.
[0097] In some cases, the first cluster 338 has more optional information items than the multiple time slots in the corresponding space of the unified user interface 300 allocated to the first cluster 338. A subset of the optional information items corresponding to the first cluster 338 is physically arranged and configured to move along a first axis 344 of the unified user interface 300, such that different information items in the subset of optional information items corresponding to the first cluster 338 can be displayed on the unified user interface 300 and recommended to the user of the television device 102. Specifically, a first user action on information item 318 (e.g., the user pressing the "previous" button on the remote control device 114) can cause information items 318 to 322 to move one time slot to the right so that information item 324 exits the unified user interface 300, and cause a new information item associated with the first cluster 338 to enter the unified user interface 300. Similarly, a second user action on information item 324 (e.g., the user pressing the "Next" button on remote control device 114) can cause information items 320 to 324 to shift one time slot to the left, causing information item 318 to exit the unified user interface 300 and allowing another new information item associated with the first cluster 338 to enter the unified user interface 300. When one of the first and second user actions is applied consecutively, the start or end information item in the first cluster 338 is displayed. When this occurs, the first or second user action may optionally not change the information item displayed on the unified user interface 300, or continue to display the end or start of a subset of optional information items in the first cluster 338 as a new information item following the start or end information item, respectively.
[0098] Furthermore, in some embodiments, multiple clusters are distributed along the second axis 346 of the unified user interface 300 and include a first subset and a second subset of clusters. The first subset of clusters can be moved out of the unified user interface, and the second subset of clusters can be moved into the unified user interface along the second axis. For example, the first subset of clusters includes cluster 334. A third user action on one of information items 302 to 308 (e.g., the user presses the "up" button on the remote control device 114) can cause clusters 334 to 338 to move down one time slot so that cluster 340 exits the unified user interface 300, and cause a new cluster preceding cluster 334 to enter the unified user interface from the top edge. Similarly, a fourth user action on one of information items 326 to 332 (e.g., the user presses the "down" button on the remote control device 114) can cause clusters 336 to 340 to move up one time slot so that cluster 334 exits the unified user interface 300, and cause another new cluster following cluster 340 to enter the unified user interface. When one of the third and fourth user actions is applied consecutively, the top or bottom cluster of multiple clusters is displayed. When this happens, one of the third and fourth user actions may optionally not change the clusters displayed on the unified user interface 300, or continue to display the bottom or top cluster of multiple clusters as a new cluster following the top or bottom cluster, respectively.
[0099] Figure 4 This is an example flowchart of a method 400 for providing knowledge-based media content recommendations to a networked television device 102 according to some implementations. Method 400 is executed by a server system 104 and optionally governed by instructions stored in a non-transitory computer-readable storage medium and executed by one or more processors of the server system 104. Figure 4 Each operation shown may correspond to a storage medium stored in computer memory or a non-transitory computer-readable storage medium (e.g., Figure 14A The instructions stored in the memory 1406 of the server system 104 are computer-readable storage media. The computer-readable storage medium may include a disk or optical disk storage device, a solid-state storage device such as flash memory, or one or more other non-volatile storage devices. The instructions stored on the computer-readable storage medium may include source code, assembly language code, object code, or one or more other instruction formats interpreted by one or more processors. Some operations in method 400 may be combined and / or the order of some operations may be changed.
[0100] Server system 104 hosts virtual user domains including user accounts. Server system 104 associates user accounts with a unified TV application 202, multiple media player applications 204, and multiple user applications (402). The unified TV application 202 is associated with a networked TV device 102, and the multiple user applications include at least an internet search engine 206. For each of the unified TV application, media player application, and user application, the server system stores (404) corresponding activity data. Specifically, server system 104 stores (406) search queries and search results of multiple search operations performed by the internet search engine 206 from user accounts, stores (408) viewing information associated with a subset of user accounts of the media player application 204, and stores (410) purchase information associated with a subset of user accounts of the user applications. From this, a multidimensional unified user activity characteristic 208 is calculated (412) from the stored activity data.
[0101] Server system 104 also obtains (414) program information associated with multiple media player applications 204, generating deduplicated program information 210 for multiple unique programs. In some embodiments, a first media content item is provided by a first media player application and associated with first program information, while a second media content item is provided by a second media player application and associated with second program information in a second media player application. Server system 104 identifies (418) the similarity level of the first and second program information. Based on the determination (418) that the similarity level exceeds a similarity threshold, server system 104 deduplicates (420) the first program information of the first media content item and the second program information of the second media content item, and determines (422) that unique programs are associated with both the first and second media content items.
[0102] Based on user activity characteristics 208 and program information 210 of multiple unique programs, server system 104 identifies (424) an ordered subset 214 of unique programs to be recommended to the user via unified TV application 202. Server system 104 enables (426) the display of an ordered sequence (e.g., items 302 to 332) of information items corresponding to the ordered subset 214 of unique programs via unified TV application 202. Each information item represents a corresponding unique program or media content item provided by the corresponding media player application 204.
[0103] Figure 5 This is an example flowchart of a method 500 for presenting program information on a networked television device 102 according to some embodiments. Method 500 is executed by the networked television device 102 and is optionally governed by instructions stored in a non-transitory computer-readable storage medium and executed by one or more processors of the networked television device 102. Figure 5Each operation shown may correspond to a storage medium stored in computer memory or a non-transient computer-readable storage medium (e.g., Figure 15 The instructions stored in the memory 1506 of the networked television device 102 are computer-readable storage media. The computer-readable storage medium may include a disk or optical disk storage device, a solid-state storage device such as flash memory, or one or more other non-volatile storage devices. The instructions stored on the computer-readable storage medium may include source code, assembly language code, object code, or one or more other instruction formats interpreted by one or more processors. Some operations in method 500 may be combined and / or the order of some operations may be changed.
[0104] The networked television device 102 is linked to a user account in a virtual user domain hosted by server system 104. The networked television device 102 executes (502) a unified television application 202 to display a unified user interface 300. It obtains (504) a media recommendation stream from server system 104, which includes an ordered sequence of optional information items 302 to 332 corresponding to an ordered set 214 of unique media content items or programs. For each optional information item, the media recommendation stream includes (506) a corresponding command to be executed in response to a user selection of the corresponding optional information item at the networked television device 102.
[0105] The networked television device 102 displays (508) multiple clusters on a unified user interface 300. Each cluster includes (510) a subset of an ordered sequence of optional information items 302 to 332. A first cluster 338 includes a first optional information item 318 and a second optional information item 320. The first and second optional information items 318 and 320 of the first cluster 338 are simultaneously displayed (510) on the unified user interface 300. In some embodiments, information about the content provider associated with the first and second optional information items is hidden on the unified user interface 300, which displays the first and second optional information items in the first cluster 338.
[0106] In response to a first user selection of a first optional information item, the networked television device 102 displays (512) information about a first media content item provided by a first content provider (e.g., via a first media player application associated with the first content provider). In response to a second user selection of a second optional information item, the networked television device 102 displays (514) information about a second media content item provided by a second content provider (e.g., via a second media player application associated with the second content provider). The second content provider is different from the first content provider. In some cases, displaying information about the first media content item includes initiating playback of the first media content item provided by the first content provider directly from the first media player application, and displaying information about the second media content item includes initiating playback of the second media content item provided by the second content provider directly from the second media player application. Alternatively, in some cases, information about the first and second media content items is displayed via the unified television application 202 on their respective media content item pages (e.g., Figure 6A On page 600 of the website.
[0107] Figure 6A and 6B These are two example media content item pages 600 and 650 displayed on a networked television device 102 according to some embodiments. In some embodiments, media content item page 600 is displayed in response to a user selection of an optional information item (e.g., item 318) in a unified user interface 300 to present information about a first media content item provided by a first media player application associated with a first content provider. The information about the first media content item includes one or more of the following: schedule information, a brief summary of the plot 612, actor information 614, rating information 616, and reviews of the first media content item. Optionally, the information about the first media content item includes one or more recommendations 618 related to the first media content item.
[0108] A list 602 of content providers offering the first media content item is displayed on the media content item page 600. The first content provider 604 is listed at the top of the content provider list 602 and has the highest priority. The user account associated with the Unified TV application 202 has subscribed to a subset or all of the content providers in list 602. In some implementations, the user account has subscribed to at least the first content provider 604, allowing the recommendation engine 212 to rely on the authorization information of the first content provider 604 and add the first content item to an ordered sequence of optional information items provided to the networked TV device 102.
[0109] Furthermore, in some cases, the list of content providers 602 includes a second content provider 606, which also provides the first media content item, and the first content provider 604 has a higher priority than the second content provider 606 in the list of content providers providing the first media content item. On the other hand, it should be noted that in response to a user selection of a different optional information item (e.g., item 320) in the unified user interface 300, a different media content item page can be displayed to present information about the second media content item. A list of different content providers is displayed, wherein the second content provider 606 is listed at the top of the list of different content providers in association with the second media content item.
[0110] refer to Figure 6B In some implementations, in response to a user selection of an optional information item (e.g., item 318) in the unified user interface 300, a media content item page 650 is displayed to present information about a first media content item provided by a first media player application associated with a first content provider. The user account does not have a subscription to the first media player application, and the media content item page 650 includes an availability item 608 linking to the first media player application to allow the user account to subscribe to the first content provider's service in response to a user action on availability item 608. In this example, the first media content item is relatively new, for example, recently discontinued in theaters and begun to be distributed by a TVOD content provider, and availability item 608 links to a Uniform Resource Locator (URL) associated with the first media player application, where viewing of the first media content item is supported on a pay-per-view basis.
[0111] Figure 7 This is an example operating environment 700 according to some implementations, in which a unified TV application 202 and a media player application 204 collaborate to play media content items on a networked TV device 102. Both the unified TV application 202 and the media player application 204 are executed by the networked TV device 102. Playback of the media content item begins in the unified TV application 202. In some cases, playback of a first media content item provided by a first content provider from a first media player application is initiated directly in response to a user action on a corresponding optional information item 318 displayed on the unified user interface 300. Alternatively, in some cases, for example, playback of the first media content item is initiated from the corresponding media content item page 600 in response to a user selecting a media content provider from a list 602 of media content providers.
[0112] When initiating playback of the first media content item, the Unified TV application 202 relies on a first or other selected media player application 204 to play the first media content item. In some embodiments, although the first media content item is played by the first media player application, the user interface elements of the first media player application are bypassed and stopped from being displayed to the user of the networked TV device 102. These bypassed user interface elements include those associated with the home user interface of the first media player application. Instead, alternative user interface features may not be skipped, and examples of these unskipped user interface features include a launch image frame indicating that the first media item is provided by a first media content provider. By bypassing the user interface elements of the first media player application, the Unified TV application 202 and the media player application 204 integrate seamlessly to enable playback of the first media content item without requiring user intervention to switch between the two applications.
[0113] Figure 8 This is an example sequence 800 of user interfaces sequentially displayed on a networked television device 102 in response to user actions on a remote control device 114 coupled to the networked television device 102, according to some implementations. When a media content item page 600 (also called a summary page) for a first media content item is displayed on the television device 102, a first media content provider 604 is selected from a list 602 of media content providers by a first user action using an instruction from a first media content provider (e.g., by pressing the play button 802 on the remote control device 114). In response to the user action, the first media content item is provided by the first media content provider 604 and played on a media player interface 804 via a first media player application associated with the first media content provider 604. The media player application is executed and hidden in the background to enable playback of the first media content item.
[0114] In some implementations, a user request to stop playback of a first media content item is received on the media player interface 804 enabled by the first media player application. In response to the user request to stop playback of the first media content item, the home user interface 806 of the first media player application is displayed, and the networked television device 102 operates in a media environment managed by the first media player application. The user of the networked television device 102 can exit the media environment by selecting an exit option on the home user interface 806 of the first media player application or by pressing one or more predefined shortcut buttons on the remote control device 114.
[0115] Alternatively, in some implementations, in response to a user request to stop playback of the first media content item on the media player interface 804, display control returns directly to the unified TV application 202 associated with the networked TV device 102. That is, in response to a user request, the networked TV device 102 displays the first media content item or multiple clustered media content item pages 600 on the unified user interface 300 via the unified TV application 202. In these ways, the involvement of the first media player application can be completely invisible to the user of the networked TV device 102, thereby allowing the media player application 204 to be seamlessly integrated within the unified TV application 202.
[0116] Figure 9 This is an example operating environment 900 according to some implementations, in which a unified TV application 202, a media player application 204, and a content casting application 902 of a networked TV device 102 cooperate to enable playback of media content items. The media player application 204 is a dedicated application associated with a specific media streaming service or broadcast channel, a cable or over-the-air (OTA) tuner, a web browser, etc. The content casting application 902 is internal to the TV device 102, which implements the connection of the unified TV application 202. The networked TV device 102 has a normal mode and a restricted mode, and the restricted mode is associated with content selection criteria. In normal mode, the media content allowed to be played via the unified TV application 202 is selected from the media content offered by each media content source 110 associated with the media player application 204, without any restrictions, except for authorization of the user account (i.e., the right to access media content permitted by a subscription). Conversely, in restricted mode, in addition to user account authorization, media content that can be played via the unified TV application 202 is selected from the media content provided by each media content source 110 associated with the media player application 204 according to content selection criteria. Therefore, the implementation of restricted mode involves operations on both the server side and the TV device side.
[0117] On the server side, recommendation engine 212 compares user activity characteristics 208 with program information 210 of multiple unique content items or programs to identify an ordered subset 214 of unique programs to be recommended to the user in normal mode. In restricted mode, during the process of obtaining the ordered subset 214 of unique programs, recommendation engine 212 applies content filtering criteria in combination with user activity characteristics 208 and other filtering conditions (e.g., authorization information of media player application 204, if any). That is, in restricted mode, the ordered subset 214 of unique programs is determined at least in part based on content filtering criteria. Optional information items displayed on television device 102 correspond to the ordered subset 214 of unique programs and are therefore selected from program information 210 associated with one or more media player applications 204 according to content selection criteria.
[0118] On the television device side, the Unified TV application 202 is executed to enable the display of the Unified User Interface 300 on the networked television device 102. In normal mode, the Unified TV application 202 does not impose any restrictions on the media content provided via the media player application 204 related to content selection criteria, and therefore the Unified TV application 202 invokes the media player application 204 to play the media content. Conversely, in restricted mode, the content selection criteria are applied via the Unified TV application 202. The Unified TV application 202 receives a user action on a first optional information item on the Unified User Interface 300. The first optional information item corresponds to a first media content item provided by the first content provider in the first media player application. In response to the user action on the first optional information item, the Unified TV application 202 determines that the Unified TV application is operating in restricted mode and the first media player application is not operating in restricted mode, and the local content casting application is invoked by the Unified TV application 202 to display the first media content item corresponding to the first optional information item on the networked television device 102.
[0119] Alternatively, in some implementations, the Unified TV application 202 determines that the Unified TV application is operating in restricted mode, and the first media player application can operate in restricted mode. The Unified TV application 202 then invokes the first media player application to display a first media content item corresponding to a first optional information item on the networked TV device 102. In restricted mode, the media player application 204 has a higher priority than the content casting application 902, which is invoked only when the media player application 204 cannot operate in restricted mode. The content casting application 902 can be locally used to represent the media player application 204, which does not meet the content selection criteria.
[0120] In some implementations, media player application 204 is associated with a corresponding third-party media content source 110 independent of the unified TV application, which is configured to introduce content selection criteria to restrict media content provided via the corresponding media player application. Alternatively, in some implementations, media player application 204 is associated with server system 104, which also implements unified TV application 202. Furthermore, in some implementations, content casting application 902 includes multiple media receiver modules 904 corresponding to the multiple media player applications 204. In restricted mode, unified TV application 202 applies content selection criteria to media content provided by the media content source 110 associated with media player application 204 via the corresponding media receiver module 904 of content casting application 902.
[0121] Figure 10A This is an example unified user interface 1000 displayed in a restricted mode on a networked television device 102 according to some implementations. Figure 10B and 10C These are two example sequences of user interfaces 1040 and 1080 sequentially displayed on the networked television device 102 in response to user actions on a remote control device 114 coupled to the networked television device 102, according to some implementations. In restricted mode, the content selection criteria define age-based content ratings, and a first media content item corresponding to a plurality of optional information items displayed on the unified user interface 1000 conforms to the age-based content rating. For example, a children's zone may be created in the corresponding unified television application 202. In some implementations, a first content provider is configured to provide one or more second media content items, each of which differs from the first media content item corresponding to the optional information item displayed on the unified user interface 1000. The one or more second media content items may be played in normal mode by a first media player application associated with the first content provider, but are prohibited from being played in restricted mode by the local content casting application 902.
[0122] In some implementations, the Unified TV application 202 loads a standard settings user interface and receives input on the standard settings user interface of a child's age associated with a user account linked to the Unified TV application 202. The Unified TV application 202 is configured to automatically identify age-based content ratings based on the child's age input. When operating in restricted mode, the server system 104 identifies age-based content ratings defined based on the child's age and selects multiple optional information items to display on the unified user interface 1000 based on the age-based content ratings, thereby creating a child-friendly media environment on the television device 102.
[0123] As described above, in restricted mode, an ordered subset 214 of unique programs is determined at least in part based on content filtering criteria. Optional information items displayed on the television device 102 correspond to this ordered subset 214 of unique programs and are selected from program information 210 associated with one or more media player applications 204 according to content selection criteria. In some embodiments, the program information 210 associated with one or more media player applications 204 includes multiple characteristic fields for each media content item or program, such as an age rating field. The recommendation engine 212 compares the value of the age rating field with an age-based content rating to determine whether the corresponding media content item or program meets the content selection criteria that define the age-based content rating.
[0124] Furthermore, in some implementations, a first optional information item is selected from first program information associated with a first media player application based on content selection criteria, and the first program information is provided at least partially by an information source different from the first media player application. For example, the first media player application (e.g., HBO) does not have a children's section, and the corresponding program information 210 for the media content items provided therefrom does not include an age rating field and may not be used to determine whether the media content items meet age-based content ratings. As a solution, the recommendation engine 212 may extract program information 210 from another information source different from the first media player application to determine whether the media content items provided via the first media player application meet age-based content ratings.
[0125] refer to Figure 10B In some implementations, when the unified user interface 1000 is displayed on the networked television device 102 to present multiple optional information items, the television device 102 receives a user selection for a first optional information item, for example, via a remote control device 114. In response to the user selection, the television device 102 initiates playback of a first media content item corresponding to the first optional information item. In this example, the television device 102 sequentially displays a start image frame 1002 and a frame indicating that the first media content item is provided by a first media content provider, followed by a frame for the first media content item 1004. (See reference...) Figure 10C In some cases, the television device 102 responds to the user's selection of the first optional information item by initiating playback of the first media content item 1006 corresponding to the first optional information item without displaying the initiating image frame 1002.
[0126] When the first media content item is played on the television device 102, the television device 102 receives a user request to stop playing the first media content item, for example, via a remote control device 114. In some embodiments ( Figure 10BBased on the determination that the unified television application 202 is operating in restricted mode, the television device 102 stops displaying the first media content item and re-displays multiple clusters with optional information items (i.e., the unified user interface 1000). Alternatively, in some embodiments ( Figure 10C Based on the determination that the unified TV application 202 operates in restricted mode, the TV device 102 stops displaying the first media content item and, in response to a user request, displays the home user interface 1008 of the first media player application. Furthermore, in response to an additional user request, the TV device 102 exits the home user interface and re-displays multiple clusters with optional information items (i.e., the unified user interface 1000). Conversely, based on the determination that the unified TV application operates in normal mode, the TV device 102 stops displaying the first media content item and implements the re-display of multiple clusters on the unified user interface 1000 and the display of one of the home user interfaces 1008 of the first media player application.
[0127] Figure 11 This is an example flowchart of a method 1100 for presenting selected media content provided by a media player application on a networked television device 102 according to some embodiments. Method 1100 is executed by the networked television device 102 and is optionally governed by instructions stored in a non-transitory computer-readable storage medium and executed by one or more processors of the networked television device 102. Figure 5 Each operation shown may correspond to a storage medium stored in computer memory or a non-transient computer-readable storage medium (e.g., Figure 15 The instructions stored in the memory 1506 of the networked television device 102 are computer-readable storage media. The computer-readable storage medium may include a disk or optical disk storage device, a solid-state storage device such as flash memory, or one or more other non-volatile storage devices. The instructions stored on the computer-readable storage medium may include source code, assembly language code, object code, or one or more other instruction formats interpreted by one or more processors. Some operations in method 1100 may be combined and / or the order of some operations may be changed.
[0128] Television device 102 is linked to a user account in a virtual user domain hosted by server system 104. Television device 102 executes (1102) a unified TV application 202 to enable the display of a unified user interface 1000 on networked television devices. Unified TV application 202 has (1104) a normal mode and a restricted mode and is associated with one or more standard media player applications 204 and a local content casting application 902. Multiple clusters are displayed (1106) on the unified user interface 1000. Each cluster has multiple optional information items. Television device 102 identifies (1108) content selection criteria and selects (1110) multiple optional information items from program information 210 associated with one or more media player applications 204 according to the content selection criteria.
[0129] Television device 102 receives (1112) a user action on a first optional information item corresponding to a first media content item provided by a first content provider in a first media player application. In response to the user action on the first optional information item (1114), based on a determination that the unified television application is operating in restricted mode and a determination that the first media player application is not operating in restricted mode, television device 102 displays (1116) the first media content item corresponding to the first optional information item on a networked television device via a local content casting application. Alternatively, in response to the user action on the first optional information item (1114), based on a determination that the unified television application is operating in normal mode, television device 102 displays (1118) the first media content item corresponding to the first optional information item on a networked television device 102 via the first media player application.
[0130] In some implementations, a first content provider is configured to provide one or more second media content items, each of which differs from a plurality of media content items corresponding to a plurality of optional information items. A first media player application is configured to play the one or more second media content items in normal mode. The one or more second media content items are prevented from being played by a local content casting application in restricted mode.
[0131] Figure 12This is an example operating environment 1200 according to some implementations, in which focused items (also called tiles) provided by a recommendation engine 212, one or more advertising (ad) providers, and a commoditization module 1202 are blended for display on a networked television device 102. The one or more advertising providers include internal advertising providers 1204 hosted and managed by a server system 104 and / or external third-party advertising sources 106 not hosted by the server system 104. An advertising management module 1208 is coupled to one or more advertising providers and is configured to manage advertising content provided by one or more advertising providers. The recommendation engine 212 is configured to compare multidimensional unified user activity characteristics 208 with program information 210 of multiple unique programs provided by media content sources 204 to identify an ordered subset 214 of unique programs to be recommended to the user via the unified television application 202. Specifically, the recommendation engine 212 may recommend media content provided by broadcast services (television, satellite, or cable television) and video-on-demand (VOD) content providers to a target user of the television device 102 based on user activity characteristics 208. The commoditization module 1202 is hosted and managed by the server system 104 and is configured to provide promotional items selected by the server system 104. The promotional items selected by the commoditization module 1202 may be determined independently of or based on user activity characteristics 208. In some implementations, the promotional items selected by the commoditization module 1202 are advertisements requesting users to subscribe to services offered by SVOD content providers, purchase or rent certain media content, or play online games. For example, promotional items selected by the commoditization module 1202 may include trailer clips related to newly released movies. In some implementations, the promotional items selected by the commoditization module 1202 are provided by TVOD content providers, independent of the user activity characteristics 208 of any particular user (i.e., the promotional items are associated with a TVOD content provider and pushed to the television device 102 by the commoditization module 1202). Alternatively, in some cases, the promotional items selected by the commoditization module 1202 are determined by the server system 104 based on the user activity characteristics 208 of multiple users across different use cases in a virtual user domain hosted by the server system 104. In the example, each focus selected by the commoditization module 1202 is determined based on one or more of the following: content type / format, content quality, recentity, popularity, seasonality, and application lifecycle.
[0132] refer to Figure 3A unified TV application 202 is executed to enable the display of a unified user interface 300 on a networked TV device 102, and the unified user interface 300 has a focus area 362 (e.g., a highlighted area of the user interface) configured to display multiple focus items. The focus area 362 is optionally located in the upper half of the unified user interface 300. Multiple focus items are displayed sequentially in the focus area 362 according to chronological order. Optionally, the multiple focus items are organized temporally as a carousel, smoothly transitioning to the start focus item after the end focus item is displayed. Each focus item is associated with a corresponding focus item provider selected from the commoditization module 1202, the advertising management module 1208, and the media recommendation engine 212. The server system 104 includes a mixer 1206 configured to automatically mix multiple focus items sequentially according to chronological order. In some embodiments, the focus area 362 is extended to partially overlap with a subset of optional information items 302 to 332. In the example, the focus area 362 covers the entire unified user interface 300 and overlaps with all optional information items 302 to 332. That is, a subset or all of the optional information items 302 to 332 are displayed on the background of the focus area 362, and multiple focus items are displayed sequentially on the background of a subset or all of the optional information items 302 to 332.
[0133] In addition, the advertising management module 1208 of the server system 104 also includes an advertising conversion module. Figure 12 (Not shown in the image), the ad conversion module is configured to customize media content items received from external ad source 106 for display in the focus area 362 of the unified user interface 300. For example, multiple focus items include a first focus item. The television device 102 sends a request for the first focus item to the first advertiser server 106, and the request includes information on multiple predefined user interface elements of the focus area of the unified user interface. In response to the request, the television device 102 receives multiple media content items associated with the first focus item from the first advertiser server 106 and merges the multiple media content items into the first focus item for display in the focus area during the time slot corresponding to the first focus item. In some embodiments, the multiple media content items include a subset of media content items that conform to the Video Ad Service Template (VAST) standard for communication requirements between the first advertiser server and the networked television device. Thus, the ad conversion module of the ad management module 1208 is configured to merge a subset of content items into the first focus item and customize the first focus item for display on the unified user interface 3000 of the networked television device 102.
[0134] Examples of predefined user interface elements for the focus area 362 include one or more of the following: a background image, a stylized title / logo image, a description including catchphrases, action calls, title text, app name, source tag, package name, clickable links, and video clips. The background image may include an image of characters without any text. The request for the first focus item sent to the first advertiser server defines which portion of the person image needs to be left empty for placing the title. In some implementations, a logo image is necessary, while a stylized font is optional and facilitates a single-line description of the media content associated with the first focus item. Action calls include actions selectable for the first focus item, such as “Subscribe Now,” “Available for Rent,” “Watch Now,” “Subscription Required,” “Go to Theater Soon,” “Add App to Favorites Row,” and “Add Channel to Home Screen,” and the server system 104 associates the first focus item with a subset of selectable actions. When a stylized title is unavailable, title text is used. The first focus item carries a source tag that highlights to the user of the television device 102 whether the content is an advertisement, a product unit, or a recommendation. Clicking a link leads to an app, content within an app, or a business webpage associated with the first focus item, and clicking the first focus item automatically activates the link.
[0135] In the example, the first focal item includes a still image of a movie playing in theaters, and the first focal item contains a link 364 for purchasing tickets and / or a link 366 for reserving a digital multifunction disc (DVD). In some implementations, the still image displays "Available now on DVD…" and has a link to rent a DVD of the corresponding movie.
[0136] In some implementations, multiple focused items include video clips or still images configured to highlight media content items provided by broadcast television services, broadcast satellite services, cable television services, SVOD content providers, or AVOD services. The recommendation engine 212 of server system 104 identifies multidimensional user activity characteristics 208 of the user of networked television device 102, obtains program information 210 associated with multiple media player applications 204, and identifies highlighted media content items for recommendation to the user via a unified television application. Specifically, the highlighted media content items are displayed to the user of television device 102 in the focused area 362 of the unified user interface 300. Information about the highlighted media content can be further provided to recommendation engine 212 to update the multidimensional user activity characteristics 208 and subsequent recommendations of media content items.
[0137] In some implementations, the plurality of focus items displayed sequentially in focus area 362 also includes a second focus item, and the second focus item includes a video clip or still image configured to highlight a media content item provided by a TVOD content provider. The video clip or still image is displayed during a time slot corresponding to the second focus item. In response to a user action on the displayed video clip or still image, a TVOD media application is executed to allow the user to subscribe to and play the media content item corresponding to the second focus item. In some cases, the video clip or still image is sponsored by a TVOD content provider or selected by server system 104 to promote the corresponding media content item independently of the user activity characteristics 208 of the user of the networked television device 102.
[0138] refer to Figure 3 In some implementations, multiple focus items are displayed simultaneously with multiple optional information items organized by clusters. While the optional information items for each cluster are distributed parallel to the first axis 344, the focus area and the multiple clusters are distributed along a second axis 346 of the unified user interface 300, which is different from the first axis 344. The focus area is fixed on the unified user interface 300, independent of the display of the multiple optional information items in non-focus areas that are different from and do not overlap with the focus area. Specifically, focus items are displayed in a fixed focus area regardless of whether optional information items move, enter, or leave the non-focus area. In some implementations, multiple focus item indicators 368 are displayed along with the focus items. Each focus item indicator 368 represents a corresponding one of the multiple focus items. For each of the multiple focus items, based on the determination that the corresponding focus item is displayed in the focus area, the television device 102 displays the corresponding focus item indicator according to the activity specification 370a. Based on the determination that the corresponding focus item is not displayed in the focus area, the television device 102 displays the corresponding focus item indicator according to the inactivity specification 370b, which is different from the activity specification 370a.
[0139] In some cases, when one of a plurality of focus items is displayed in focus area 362, television device 102 receives a predefined user action associated with the corresponding focus item (e.g., clicking a "previous" or "next" button on remote control device 114). In response to the predefined user action, television device 102 stops displaying the corresponding focus item and displays (1) a subsequent focus item that follows the corresponding focus item in chronological order, or (2) a previous focus item that precedes the corresponding focus item in chronological order, in the focus area of the unified user interface.
[0140] The featured items are frequently updated in the featured area 362 to maintain their freshness. For example, the server system 104 determines the number of times that multiple featured items have been displayed sequentially in the featured area 362 according to chronological order. Based on the determination that the number is equal to or greater than a predetermined playback threshold (e.g., 2 times), the server system 104 replaces at least one of the multiple featured items with an alternative featured item.
[0141] Furthermore, in some implementations, server system 104 is configured to deduplicate the focused items displayed sequentially in focused area 362. In addition to the first focused area, multiple focused items also include a second focused item. Mixer 1206 receives two or more original items, each from a distinct content provider selected from commoditization module 1202, advertiser 106, and media recommendation engine 212. Mixer 1206 deduplicates the two or more original items according to a preferred order of commoditization module 1202, advertiser 106, and media recommendation engine 212 to produce the second focused item. In this example, the preferred order defines a decreasing preference for advertiser 106, commoditization module 1202, and media recommendation engine 212, prioritizing advertiser 106 over any other content source.
[0142] In some implementations, information about user actions associated with the focus area is provided to one of the commodification module 1202, recommendation engine 212, and advertising management module 1208 that provides the focus items displayed in the focus area. The user action information indicates the user of the networked television device 102's user preferences regarding the multiple focus items displayed in the focus area. Each of the recommendation engine 212, advertising management module 1208, and commodification module 1202 can determine one or more additional focus items for the user based on the user's user preferences or based on the user preferences of multiple users associated with the user of the networked television device 102.
[0143] Figure 13 This is an example flowchart of a method 1300 for mixing focused content (including VAST-based advertising) on a networked television device 102 according to some implementations. Method 1300 is executed by server system 104 and optionally governed by instructions stored in a non-transitory computer-readable storage medium and executed by one or more processors of server system 104. Figure 13 Each operation shown may correspond to a storage medium stored in computer memory or a non-transitory computer-readable storage medium (e.g., Figure 14AThe instructions stored in the memory 1406 of the server system 104. The computer-readable storage medium may include a disk or optical disk storage device, a solid-state storage device such as flash memory, or one or more other non-volatile storage devices. The instructions stored on the computer-readable storage medium may include source code, assembly language code, object code, or one or more other instruction formats interpreted by one or more processors. Some operations in method 1300 may be combined and / or the order of some operations may be changed.
[0144] Server system 104 hosts a virtual user domain including user accounts. User accounts are associated with a unified TV application 202 and multiple media player applications 204 (1302). The unified TV application 202 is associated with a networked TV device 102 (1304) and is configured to display media content on the TV device 102, and each of the multiple media player applications 204 is configured to display media content provided by a corresponding content provider 110. The unified TV application 202 is executed (1306) to display a unified user interface on the networked TV device 102. The unified user interface 300 has a focus area 362 configured to display multiple focus items. The multiple focus items (also called tiles) are displayed sequentially in focus area 362 according to a chronological order (e.g., similar to a turntable) (1308). Each focus item is associated with a corresponding focus item provider selected from a commoditization module, advertisers, and a media recommendation engine.
[0145] Multiple focus items include a first focus item. Server system 104 sends (1310) a request for the first focus item to a first advertiser server. The request includes information about multiple predefined user interface elements of the focus area of a unified user interface. In response to the request, server system 104 receives (1312) multiple media content items associated with the first focus item from the first advertiser server and merges the multiple media content items into the first focus item for display on focus area 362 during the time slot corresponding to the first focus item.
[0146] In some embodiments of the disclosed subject, the unified user interface may include multiple tabbed interfaces, one of which includes upcoming media content (e.g., a "coming soon" tabbed interface). For example, a tabbed interface including upcoming media content may present a media recommendation stream comprising an ordered set of upcoming media content items, wherein upcoming media content items in the media recommendation stream may be selected from different content sources based on user activity data with a unified user interface, each of multiple media player applications (e.g., YouTube, Google Play, Netflix, Hulu, Amazon Prime, TV channel applications, etc.), and each of multiple user applications (e.g., email applications, map applications, accessibility applications, home device applications, online retailer applications, etc.). Continuing with this example, the upcoming media content in the tabbed interface may be organized into multiple clusters based on one or more categories, such as: release time (e.g., "this week," "next week," "next month," etc.), user actions and user application interactions (e.g., "my coming soon" content items), media player application usage (e.g., upcoming items from a specific media player application), etc.
[0147] Figure 16 This is an example flowchart of a method 1600 for providing knowledge-based media content recommendations to a networked television device 102 according to some implementations. Method 1600 can be executed by a server system 104 and can optionally be governed by instructions stored in a non-transitory computer-readable storage medium and executed by one or more processors of the server system 104. Figure 16 Each operation shown may correspond to a storage medium stored in computer memory or a non-transitory computer-readable storage medium (e.g., Figure 14A The instructions stored in the memory 1406 of the server system 104. The computer-readable storage medium may include a disk or optical disk storage device, a solid-state storage device such as flash memory, or one or more other non-volatile storage devices. The instructions stored on the computer-readable storage medium may include source code, assembly language code, object code, or one or more other instruction formats interpreted by one or more processors. Some operations in method 1600 may be combined and / or the order of some operations may be changed.
[0148] Server system 104 can host virtual user domains that include user accounts. Server system 104 associates user accounts with a unified TV application 202, multiple media player applications 204, and multiple user applications (1602). Unified TV application 202 can be associated with a networked TV device 102, and the multiple user applications include at least an internet search engine 206. For each of the unified TV application, media player application, and user application, the server system stores (1604) the corresponding activity data.
[0149] In some implementations, server system 104 may store (1606) search queries and search results from multiple search operations performed by internet search engine 206 from a user account. For example, server system 104 may determine that a user of the user account has entered a search query for a media content item. Such a search query may be received, for example, via a microphone on the networked television device 102 or an associated remote control device. Continuing with this example, when one or more search results include upcoming media content that is not currently available for playback on the networked television device, the search results may be included in a media recommendation stream used to present clusters of upcoming media content items on a tabbed interface (e.g., an "Upcoming" tabbed interface). In another example, when one or more search results include upcoming media content that is not currently available for playback on the networked television device, the user of the user account may select upcoming media content items to include in a media recommendation stream used to present clusters of upcoming media content items on a tabbed interface (e.g., the "My Upcoming" cluster in the "Upcoming" tabbed interface). It should be noted that search queries and search results may also be performed by an auxiliary application or any other suitable user application running on the networked television device 102.
[0150] In some implementations, server system 104 may store (1608) viewing information, media interaction information, and application usage information associated with user accounts of a subset of media player applications 204. For example, server system 104 may determine that a user of a user account has selected a media content item available from a content source for playback, and in response, may select upcoming media content items similar to the selected media content item to include in a media recommendation stream used to present clusters of upcoming media content items on tabbed interfaces. In another example, server system 104 may determine that a user of a user account has selected a media player application from one of the tabbed interfaces for viewing media content items (e.g., a "Home" tabbed interface), and in response, may select upcoming media content items associated with a content source corresponding to the selected media player application to include in a media recommendation stream used to present clusters of upcoming media content items on tabbed interfaces for upcoming media content items (e.g., an "Upcoming" tabbed interface).
[0151] In some implementations, media interaction information may also include purchase information associated with user accounts of a subset of user applications. For example, server system 104 may store purchase information indicating that a user has purchased upcoming media content items that are not currently available for playback. In response, server system 104 may add the upcoming media content items purchased by the user account to a media recommendation stream used to present clusters of upcoming media content items on a tabbed interface for upcoming media content (e.g., an "Upcoming" tab).
[0152] In some implementations, server system 104 may store (1610) user actions associated with a user account. For example, server system 104 may determine that a user of a user account has entered a search query for a media content item and that the user has, in response to the search query, selected an upcoming media content item from the search results to include in a media recommendation stream for presenting the upcoming media content item in a tabbed interface (e.g., the "My Upcoming" cluster in the "Upcoming" tab interface). In another example, server system 104 may determine that a user of a user account has interacted with an upcoming media content item on a different tabbed interface (e.g., the "Home" tab interface) and that the user has, in response to the search query, selected an upcoming media content item from the search results to include in a media recommendation stream for presenting the upcoming media content item in a tabbed interface (e.g., the "My Upcoming" cluster in the "Upcoming" tab interface). In yet another example, server system 104 may determine that a user of a user account has interacted with a media player application, and in response, server system 104 may recommend upcoming media content items associated with content sources corresponding to the media player application to be included in a media recommendation stream for presenting upcoming media content items in a tabbed interface (e.g., an "Upcoming" tabbed interface).
[0153] In some implementations, this can be used to calculate (1612) multidimensional unified user activity characteristics 208 from stored activity data.
[0154] Similar to Figure 4 The server system 104 can also obtain (1614) program information associated with multiple media player applications 204, generating deduplicated program information 210 for multiple unique programs. In some embodiments, a first upcoming media content item may be provided by a first media player application and associated with first program information, and a second upcoming media content item may be provided by a second media player application and associated with second program information in a second media player application. The server system 104 can identify (1618) the similarity level of the first and second program information. Based on the determination (1618) that the similarity level exceeds a similarity threshold, the server system 104 can deduplicate (1620) the first program information of the first upcoming media content item and the second program information of the second upcoming media content item, and can determine (1622) that unique programs are associated with both the first and second upcoming media content items.
[0155] Based on user activity characteristics 208 and program information 210 of multiple unique programs, server system 104 can identify (1624) an ordered subset 214 of unique programs for recommendation to the user via unified television application 202. Server system 104 can enable (1626) the display (e.g., of ordered subset 214 of unique programs) of ordered sequence of information items corresponding to this ordered subset 214 via unified television application 202. Figure 18 (Items 1802 to 1830 in the document). Each information item represents a unique program or media content item provided by the corresponding media player application 204. For example, as shown in the document... Figure 18 As shown, each information item can represent an upcoming media content item from a different content source.
[0156] Figure 17 This is an example flowchart of method 1700 for presenting program information in a tabbed interface according to some embodiments, the tabbed interface including upcoming media content items on a networked television device 102. Method 1700 can be executed by the networked television device 102 and can optionally be governed by instructions stored in a non-transitory computer-readable storage medium and executed by one or more processors of the networked television device 102. Figure 17 Each operation shown may correspond to a storage medium stored in computer memory or a non-transient computer-readable storage medium (e.g., Figure 15 The instructions stored in the memory 1506 of the networked television device 102 are computer-readable storage media. The computer-readable storage medium may include a disk or optical disk storage device, a solid-state storage device such as flash memory, or one or more other non-volatile storage devices. The instructions stored on the computer-readable storage medium may include source code, assembly language code, object code, or one or more other instruction formats interpreted by one or more processors. Some operations in method 500 may be combined and / or the order of some operations may be changed.
[0157] The networked television device 102 can be linked to user accounts in a virtual user domain hosted by the server system 104. For example, a user account can be associated with a unified user interface presented on the networked television device 102, multiple media player applications running on the networked television device 102, and multiple user applications running on the networked television device 102. Examples of media player applications may include, but are not limited to, YouTube, Google Play, Netflix, Hulu, Amazon Prime, HBO, and some television channel applications (e.g., ESPN, NBC, ABC, PBS, etc.). Examples of user applications may include, but are not limited to, email applications (e.g., Google Gmail), map applications (e.g., Google Maps), accessibility applications (e.g., Google Assistant), home device applications (e.g., Google Home, Nest Camera, Nest Hello, etc.), and online retailer applications (e.g., Google Shopping).
[0158] The networked television device 102 can execute (1702) the unified television application 202 to display a unified user interface 1800. Media recommendation streams can be obtained from the server system 104 (1704) and can include... Figure 18 The media recommendation stream comprises an ordered sequence of optional information items 1802 to 1830, which corresponds to an ordered set 214 of unique media content items or programs. For each optional information item, the media recommendation stream includes (1706) a corresponding command to be executed in response to the user's selection of the corresponding optional information item at the networked television device 102.
[0159] In some implementations, the unified user interface 1800 may include multiple tabbed interfaces 1850, wherein one of the tabbed interfaces 1850 corresponds to upcoming media content. For example... Figure 18 As shown, a tabbed interface corresponding to the upcoming media content (e.g., the "Coming Soon" tab) has been selected from multiple tabbed interfaces 1850. Also as... Figure 18 As shown, one of the tabbed interfaces 1850 can correspond to a search engine interface for searching media content available for the networked television device 102, or a main interface that presents recommended media content items and can be configured by the user's account. It should be noted that any appropriate number of tabs can be included in multiple tabbed interfaces 1850.
[0160] For example, in some implementations, a tabbed interface that includes upcoming media content can present a media recommendation stream that includes an ordered set of upcoming media content items, wherein upcoming media content items in the media recommendation stream can be selected from different content sources based on user activity data with a unified user interface, each of multiple media player applications (e.g., YouTube, Google Play, Netflix, Hulu, Amazon Prime, TV channel applications, etc.), and each of multiple user applications (e.g., email applications, map applications, accessibility applications, home device applications, online retailer applications, etc.).
[0161] The networked television device 102 can display (1708) multiple clusters 1840 to 1844 on a unified user interface 1800. Each cluster 1840 to 1844 may include (110) a subset of an ordered sequence of optional information items 1802 to 1830. For example, among other things, the first cluster 1840 may also include a first optional information item 1802 and a second optional information item 1804. The first and second optional information items 1802 and 1804 of the first cluster 1840 may be displayed (510) simultaneously on the unified user interface 1800. In some embodiments, information about the content provider associated with the first and second optional information items may be hidden on the unified user interface 1800, which displays the first and second optional information items in the first cluster 1840. It should be noted that each cluster 1840 to 1844 may include any appropriate number of information items, each representing an upcoming media content item.
[0162] like Figure 18 As shown, the unified user interface 1800 may include a tabbed interface, wherein one of the tabbed interfaces includes upcoming media content that is organized into multiple clusters based on one or more categories, such as: release time (e.g., “this week”, “next week”, “next month”, etc.), user actions and user application interactions (e.g., “My upcoming” content items), media playback application usage (e.g., as an upcoming item from “App ABC”), etc.
[0163] In response to a first user interaction with a first optional information item, the networked television device 102 may display additional information about a first upcoming media content item (e.g., retrieved from a first content provider, provided from a first media player application associated with the first content provider, etc.). For example, such as Figure 19As shown, in response to hovering over information item 1802 using a remote control or any other suitable input device, highlighting information item 1802, or otherwise interacting with information item 1802, the unified user interface 1800 can be updated by modifying the size of the tile of information item 1802 to that of information item 1910 and by displaying additional information 1920 of upcoming media content items (e.g., media title, release date, content type, brief description of media content item, rating information, actor information, time information, etc.).
[0164] In response to a second user interaction with a second optional information item, the networked television device 102 can display additional information for a second upcoming media content item. For example, such as Figure 20 As shown, in response to hovering over, highlighting, or otherwise interacting with information item 1804 using a remote control or any other suitable input device after a previous interaction with information item 1802, the unified user interface 1800 can be updated by modifying the tile size of information items 1802 and 1804 (e.g., where the tile size of information item 1910 is returned to information item 1802, and the tile size of information item 1804 is modified to information item 2010), and displaying additional information 1920 of upcoming media content items for information item 1804 (e.g., media title, release date, content type, brief description of media content item, rating information, actor information, timing information, etc.), while disabling the display of additional information 1920 of upcoming media content items for information item 1802.
[0165] It should be noted that both the first and second optional information items can be associated with upcoming media content items provided by different content sources. For example, such as Figure 18 As shown, each information item in cluster 1840 can be provided by different content sources (e.g., different media content providers).
[0166] It should also be noted that the response to the first or second user interaction lasts for a period of time exceeding a threshold (e.g., more than five seconds). Figure 19 Information item 1910 or Figure 20Information item 2010 can be replaced by a preview of an upcoming media content item. For example, in response to determining that a preview of an upcoming media content item is available from the corresponding content provider, and in response to determining that user interaction (e.g., hover, highlighting, etc.) has continued for more than a threshold time period, the unified user interface 1800 can be updated by replacing the static representation of the upcoming media content item (e.g., thumbnail, tile, etc.) with a preview of the upcoming media content item retrieved from the corresponding content provider and automatically started being played back. Continuing with this example, in response to determining that user interaction has stopped (e.g., moving the highlighted area to another information item), the unified user interface 1800 can be updated by disabling the presentation of the preview of the upcoming media content item, and can replace the preview of the upcoming media content item with a static representation of the upcoming media content item.
[0167] In some implementations, the selection of the first and second optional information items in clusters 1840 to 1844 can be configured in any suitable manner. For example, the first and second optional information items in the "This Week" cluster 1840 can be selected based on: user activity data with a unified user interface (e.g., user interactions and / or item selections within the unified user interface, user interactions and / or item selections within different tabs of the unified user interface, etc.), user activity data with each of multiple media player applications (e.g., media player applications already installed on the networked TV device 102, media player applications accessed more frequently, media player applications used more than a threshold number of times to play back media content items, etc.), and user activity data with each of multiple user applications (e.g., user-inputted search requests, search results selected by the user in auxiliary applications, etc.). In another example, such as Figure 18 As shown, a first optional information item and a second optional information item in the "This Week" cluster 1840 can be selected based on the type of user activity data selected in response to the selection channel customization interface element 1860. Continuing with this example, in response to the selection channel customization interface element 1860, the unified user interface 1800 can be updated to provide the user with the opportunity to select user activity data (e.g., movie and episode content from a specific content provider, movie or episode content available next month, movie and episode content related to the selected user search results from the auxiliary application but unrelated to the search results from the mapping application, etc.) for selecting upcoming media content items in the media recommendation stream.
[0168] In a more specific example, optional information items corresponding to upcoming media content items in the media recommendation stream can be selected based on the search results entered by the user. For example... Figure 21As shown, in the "Search" tab of the unified user interface 1800, a search query 2110 for "the kingsman" can be received from the user (wherein, the search query can be entered into the search interface presented on the networked TV device 102 via text input using a remote control device, audio input via a microphone on the networked TV device 102 or the remote control device, etc.). In response to receiving the search query 2110, the networked TV device 102 can update the unified user interface 1800 to present search results 2120 to 2140 in response to the search query 2110, where each search result can be optional. Continuing with this example, in response to selecting a search result, such as search result 2140 for an upcoming media content item titled "The King's Man," the networked TV device 102 can update the unified user interface 1800 to display as follows: Figure 22 Additional information 2210 for upcoming media content items shown (e.g., media title, release date, content type, content category, brief description of the media content item, rating information, actor information, time information, etc.).
[0169] In some implementations, when viewing additional information for upcoming content items in search results, the unified user interface 1800 may provide the user with an interface element 2210. Selecting this interface element 2210 causes the selected upcoming content item to be added to a media recommendation stream of upcoming media content presented in the tabbed interface of the unified user interface 1800. For example, as... Figure 23 As shown, in response to selecting interface element 2210 to add an upcoming content item titled "The King's Man" to the media recommendation stream of upcoming media content, a selection confirmation interface 2310 (e.g., "Add to Upcoming") can be presented on the unified user interface 1800. The upcoming media content item can be added to clusters 1840, 1842, or 1844, for example, based on whether it meets the availability criteria associated with each cluster. In another example, the upcoming media content item can be added to a cluster that includes upcoming media content items selected by the user (e.g., the "My Upcoming" cluster).
[0170] In some implementations, when viewing additional information for upcoming content items in search results, the unified user interface 1800 can provide the user with relevant media content items. For example, returning to a reference. Figure 22 The unified user interface 1800 can provide the user with one or more media content items 2230 related to the search results. These media content items 2230 can include available media content items and / or upcoming media content items. Similar to... Figure 22In response to the selection of one of the relevant media content items, the networked TV device 102 can update the unified user interface 1800 to display additional information about the media content item (e.g., media title, release date, content type, content category, brief description of the media content item, rating information, actor information, time information, etc.).
[0171] It should also be noted that the first and second optional information items can be associated with upcoming media content items of different content types. For example, as in Figure 19 and Figure 20 The additional information presented in relation to each upcoming media content item that the user has already interacted with is shown in the accompanying text. Figure 19 The first optional information item 1910 corresponds to the upcoming media content item associated with the movie, while... Figure 20 The second optional information item, 2010, corresponds to the upcoming media content item and is associated with series or other plot content. Any suitable content type can be included within each cluster, such as film content, television content, series or plot content, audio content, game content, etc.
[0172] In another, more specific example, optional information items corresponding to upcoming media content items in the media recommendation stream can be selected based on user activity in other tabbed interfaces of the unified user interface 1800. For example, returning to the reference... Figure 18 The unified user interface 1800 may include multiple tabbed interfaces, one of which includes upcoming media content (e.g., an "Upcoming" tabbed interface), while another tabbed interface includes a media content recommendation interface presented when the unified TV application is executed (e.g., a "Home" tabbed interface). Figure 24 and Figure 25 In response to selecting a recommended media content item in the "Home" tabbed interface of the unified user interface 1800, the networked television device 102 can store user activity, such as the selected media content item, media content items related to the selected media content item, metadata associated with the selected media content item, media player applications associated with the selected media content item, and content providers associated with the selected media content item. Figure 25As shown, in response to selecting a recommended media content item 2410 provided by a specific content provider (e.g., provider A) in the "Home" tabbed interface of the unified user interface 1800, the unified user interface 1800 may provide the user with an options interface 2510, which includes an upcoming option 2512 for adding the recommended content item to the tabbed interface of upcoming media content (e.g., in response to determining that the selected content item is currently unavailable but meets the availability criteria of clustering in the tabbed interface of upcoming media content items), a queueing option 2514 for adding the recommended content item to the playback queue of the media content, and / or a removal option 2516 for removing the selected content item from the user account recommended to the user in any tabbed interface of the unified user interface 1800.
[0173] Combination Figure 22 and Figure 25 In the example above, in response to a selection, the selected upcoming content item is added to the media recommendation stream of upcoming media content presented in the tabbed interface of the unified user interface 1800. Figure 22 The interface element 2210, and the tabbed interface that responds to selection to add recommended content items to upcoming media. Figure 25 The upcoming option 2512 allows upcoming content items to be added to the media recommendation stream of upcoming media content and presented in clusters that include the user-selected upcoming media content items (e.g., the "My Upcoming" cluster). For example, as... Figure 26 As shown, cluster 2610 on the tabbed interface of the upcoming media content item can be updated to include optional information item 2140 and optional information item 2410.
[0174] In some implementations, the tabbed interface of the unified user interface 1800 can also be updated to include clusters corresponding to specific media player applications or specific content providers, based on user activity with a particular media player application or content provider. For example, as... Figure 26 As shown, upcoming content items in the media recommendation stream associated with a specific media player application can be presented in cluster 2620 (e.g., upcoming content "from application").
[0175] In some implementations, for interaction with optional information items in the tabbed interface of the unified user interface 1800, selecting the information item corresponding to the upcoming media content item can result in the presentation of an options interface, such as... Figure 27Options interface 2710. For example, in response to selecting information item 1802, options interface 2710 may be an overlay interface that includes: a notification option 2712 for being notified when an upcoming content item becomes available from the corresponding content provider (e.g., using the corresponding media player application); a queue option 2714 for automatically adding the upcoming content item to the playback queue of the media content when it becomes available from the corresponding content provider; and / or, a removal option 2716 for removing the upcoming content item from the user's account in the media recommendation stream.
[0176] In response to the selection of an option to be notified about the availability of upcoming media content items (e.g., selecting notification option 2712 associated with information item 1802), the networked television device 102 can provide notifications to users of a user account within a unified user interface. For example, as Figure 28 As shown, a notification overlay 2800 can be presented within the unified user interface. In a more specific example, the notification overlay 2800 can be positioned as having a focus area, such as focus area 362 located in the upper half of the unified user interface 1800. Figure 28 As shown, notification overlay 2800 can be positioned over one or more focused items currently being presented in the focused area.
[0177] Additionally or alternatively, in some implementations, a notification indicator may be presented within the unified user interface 1800, and once selected, the notification indicator may provide the user with one or more notifications, such as notifications of the availability of upcoming media content items (e.g., notifications that upcoming media content items are available for playback and can be added to the playback queue, notifications that upcoming media content items will be available for playback in the next 24 hours, etc.).
[0178] Additionally or alternatively, in some embodiments, the networked television device 102 may provide detailed notifications with one or more tabbed interfaces. For example, such as Figure 29 As shown, a notification panel 2900 can be presented within a unified user interface 1800, wherein one or more clusters of recommended media content items can be scrolled down, allowing the notification panel 2900 to be presented in the first row of each tabbed interface. Similarly, as... Figure 29As shown, for an upcoming media content item that is now available for playback using the corresponding media player application, notification panel 2900 may include the title of the media content item (e.g., "Upcoming Movie Title A"), a description of the media content item, and / or any other suitable information. In some embodiments, notification panel 2900 may include a details option 2910 that, when selected, presents additional information related to the media content item (e.g., such as...). Figure 23 (Additional information in the document). In some implementations, the notification panel 2900 may include a deactivation option 2920 that, when selected, prevents the notification panel 2900 from being displayed within the unified user interface 1800. For example, in response to selecting the deactivation option 2920, the notification panel 2900 may be removed, and the cluster of recommended media content items may be moved up to its initial position.
[0179] It should be understood that Figure 4 , 5 The specific order in which the operations in each of 11, 13, 16, and 17 are described is merely exemplary and is not intended to indicate that the described order is merely the only possible order in which the operations can be performed. Those skilled in the art will recognize the various ways in which information items and focused content are displayed in a unified user interface as described herein. Furthermore, it should be noted that the details described with respect to one of methods 400, 500, 1100, 1300, 1600, and 1700 can also be applied in a similar manner to any other method in methods 400, 500, 1100, 1300, 1600, and 1700. For the sake of brevity, similar details are not repeated.
[0180] Figure 14AThis is a block diagram illustrating a server system 104 in a media environment according to some embodiments. Server system 104 typically includes one or more processing units (CPUs) 1402, one or more network interfaces 1404, memory 1406, and one or more communication buses 1408 for interconnecting these components (sometimes referred to as chipsets). Server system 104 may include one or more input devices 1410 to facilitate user input, such as a keyboard, mouse, voice command input unit or microphone, touchscreen display, touch-sensitive input pad, gesture capture camera, or other input buttons or controls. Furthermore, server system 104 may use a microphone and voice recognition or a camera and gesture recognition to supplement or replace the keyboard. In some embodiments, server system 104 includes one or more cameras, scanners, or light sensor units for capturing images, such as graphic serial codes printed on electronic devices. Server system 104 may also include one or more output devices 1412 that enable the presentation of a user interface and display content, including one or more speakers and / or one or more visual displays.
[0181] Memory 1406 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally, includes non-volatile memory, such as one or more disk storage devices, one or more optical disk storage devices, multiple flash memory devices, or multiple other non-volatile solid-state memory devices. Optionally, memory 1406 includes one or more storage devices remote from one or more processing units 1402. Memory 1406, or alternatively, the non-volatile memory within memory 1406 includes a non-transitory computer-readable storage medium. In some embodiments, memory 1406 or the non-transitory computer-readable storage medium of memory 1406 stores programs, modules, and data structures, or subsets or supersets thereof:
[0182] Operating system 1416 includes procedures for handling various basic system services and for performing hardware-related tasks;
[0183] The network communication module 1418 is used to connect the server system 104 to other devices (e.g., various servers in the server system 104, advertising sources 106, EPG sources 108, media content sources 110, networked TV devices 102, remote control devices 114, media devices 114 to 126, auxiliary devices 138, home appliances 140 and mobile devices) via one or more network interfaces 1404 (wired or wireless) and one or more networks 112 (such as the Internet, other wide area networks, local area networks, metropolitan area networks, etc.).
[0184] Playback device application 1420 is executed to provide server-side functions for device provisioning, device control, and user account management associated with playback device 118;
[0185] One or more internal media player applications 1422 (e.g., YouTube and Google Play) are executed to provide server-side functionality for media display and user account management;
[0186] One or more user applications 1424, including one or more of internet search engines, map applications, social media applications, retailer applications, and device applications, are executed to provide server-side functions for device supply, device control, data processing, and data review for the corresponding auxiliary device 138 or home device 140; and
[0187] Server-side TV application 134 is executed to provide server-side functions for device supply, device control, data processing, and data review for networked TV device 102;
[0188] Knowledge graph engine 130 is executed to collect activity data from media player applications and user applications associated with user accounts, calculate multidimensional unified user activity characteristics 208 based on the collected activity data, and collect program information associated with media player applications 204 (with or without deduplication).
[0189] Recommendation engine 212 is executed to compare user activity characteristics 208 with program information 210 of multiple unique programs to identify an ordered subset 214 of unique programs to be recommended to the user via Unified TV application 202.
[0190] The commoditization module 1202 is executed to provide a focus for promoting media content by selecting user activity characteristics 208 that are independent of individual user accounts;
[0191] An advertising management module 1208 is executed to manage advertising content provided by an internal advertising provider 1204 or an external advertising source 106, including an advertising conversion module that is executed to customize media content items received from the external advertising source 106, for example, according to a customized VAST format, for display in the focus area 362 of a unified user interface 3000.
[0192] Mixer 1206 (also known as the focus aggregation module) is executed to sequentially mix multiple focus items provided by two or more content sources (e.g., recommendation engine 212, commoditization module 1202, and advertising provider 1204 or 106) according to chronological order; and
[0193] Media search engine 222 is executed to receive search queries from server-side television application 134 or projection service module 136, and to identify one or more media content items from program information provided by media content source 110; and
[0194] Server system data 1440 stores at least the data associated with the control of media display on the networked television device 102, including:
[0195] User account settings 1442, used to store account settings for one or more user accounts, as well as settings for devices and applications associated with each user account and managed by server system 104, also includes:
[0196] Television device settings 1444 are used to store: information associated with television device 102, including common device settings (e.g., service layer, device model, storage capacity, processing power, communication capabilities, etc.); and information associated with the corresponding unified television application 202 (including one or more of account access information, user preferences for media content types, and viewing history data).
[0197] Projection device settings 1446 are used to store information associated with user accounts of projection device 118 and projection device application 1420, including one or more of account access information and device settings information (e.g., service layer, device model, storage capacity, processing power, communication capabilities, etc.).
[0198] Media player application settings 1448 are used to store information associated with one or more user accounts of media player applications 204, including one or more of account access information, user preferences for media content types, and viewing history data.
[0199] Remote control settings 1450 are used to store information associated with one or more remote control devices 114, such as general device settings (e.g., service layer, device model, storage capacity, processing power, communication capabilities, etc.), media control functions linked to individual buttons, and commands and data for implementing the functions of each media content; and
[0200] Device and application registry 150 is used to store information about one or more user accounts managed by server system 104, as well as information about user devices and applications associated with each of the one or more user accounts;
[0201] User account data 1454 is used to store data generated by various applications of multiple devices associated with each user account managed by server system 104, such as display information associated with media content currently displayed on television device 102;
[0202] The knowledge graph data 1456 associated with the knowledge graph engine 130 implemented in the server system 104 includes one or more of the following: activity data 1458 of the unified TV application 202, media player application 204, and user application 1424; multi-dimensional unified user activity characteristics 208 derived from the activity data; and program information 210 associated with multiple media player applications 204; and
[0203] One or more content selection criteria 1460 applied by the Unified Television Application 202 are used to control the media content displayed on the television device 102.
[0204] Each of the elements identified above can be stored in one or more of the aforementioned memory devices and corresponds to an instruction set for performing the functions described above. The modules or programs identified above (i.e., instruction sets) do not need to be implemented as separate software programs, processes, modules, or data structures; therefore, various subsets of these modules can be combined or otherwise rearranged in various embodiments. In some embodiments, memory 1406 may optionally store a subset of the modules and data structures identified above. Furthermore, memory 1406 may optionally store additional modules and data structures not described above.
[0205] Figure 14B This is an example device and application registry 150 of server system 104 according to some implementations, which stores information about one or more user accounts managed by server system 104, as well as information about user devices and applications associated with each of the one or more user accounts. In this example, user account 1482 is defined by an email address (e.g., abc@gmail.com), and user account 1482 is associated with multiple user devices, including a projection device 118 (e.g., Google Chromecast), a surveillance camera 148 (e.g., Nest camera), and a remote control device 114. Device and application registry 150 stores one or more of the following for each user device associated with a user account: device identifier (ID), device type, device manufacturer ID, and Internet Protocol (IP) address. When a user device is linked to user account 1482, a device ID is assigned to the user device. The manufacturer ID includes a product serial number provided by the manufacturer to uniquely identify the user device. When each user device is linked to user account 1482, the corresponding manufacturer ID is requested for the purpose of authenticating the corresponding user device. The IP address of the user device is used to track the location of the user device on the Internet. They are obtained during the process of linking the user device to user account 1482, and are updated when the user device’s location on the Internet changes.
[0206] In some implementations, a first user device associated with user account 1482 is linked to a second user device associated with user account 1482. For example, remote control device 114 (device ID = 10) is linked to networked television device 102 (device ID = 11) but not to projection device 118 (device ID = 1). In some implementations, user account 1482 includes two or more remote control devices 114, each uniquely linked to a specific networked television device 102 or projection device 118. In some implementations, user account 1482 includes one remote control device 114 that is linked to more than one projection or television device according to predetermined linking rules (e.g., based on the distance of remote control device 114 to any one of the more than one projection or television devices).
[0207] In some implementations, user account 1482, defined by an email address (e.g., abc@gmail.com), is also associated with unified TV application 202, multiple media player applications 204, and multiple user applications 1424. Each media player application 204 is configured to display media content items or programs provided by broadcast services (television, satellite, or cable TV) and VOD content providers. VOD content providers may optionally be server system 104 or third-party content providers different from server system 104. Examples of media player applications 204 include, but are not limited to, YouTube, Google Play, Netflix, Hulu, Amazon Prime, HBO, and some television channel applications (e.g., ESPN, NBC, ABC, and PBS). Conversely, examples of multiple user applications 1424 include email applications (e.g., Google Gmail), map applications (e.g., Google Maps), accessibility applications (e.g., Google assistance), home device applications (e.g., Nest Camera, NestHello), and online retailer applications (e.g., Google Shopping). Optionally, each media player or user application stores one or more of the following: application identifier (ID), application type, a flag indicating whether it is a first-party application or a third-party application, and authorization / subscription information (e.g., membership type, certificate).
[0208] Figure 15This is a block diagram illustrating an example networked television device 102 configured to display a unified user interface and media content provided by a media player application 204, according to some embodiments. The networked television device 102 typically includes one or more processing units (CPUs) 1502, one or more network interfaces 1504, memory 1506, and one or more communication buses 1508 for interconnecting these components (sometimes referred to as chipsets). Memory 1506 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally, memory 1506 includes non-volatile memory, such as one or more disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid-state storage devices. Optionally, memory 1506 includes one or more storage devices located remotely from one or more processing units 1502. Memory 1506, or alternatively, non-volatile memory within memory 1506, includes non-transitory computer-readable storage media. The television device 102 may include one or more input devices 1510 for user input, such as input buttons or controls. In addition, the television device 102 may use a microphone and voice recognition or a camera and gesture recognition to supplement or replace buttons. The television device 102 may also include one or more output devices 1512 that enable the presentation of a user interface and display content, including speakers and / or visual displays.
[0209] In some implementations, memory 1506 or a non-transitory computer-readable storage medium of memory 1506 stores the following programs, modules, and data structures, or subsets or supersets thereof:
[0210] Operating system 1514 includes procedures for handling various basic system services and for performing hardware-related tasks;
[0211] The network communication module 1516 is used to connect the networked television device 102 to other computers or systems (e.g., server system 104, media content source 110, remote control device 114) via one or more network interfaces 1504 (wired or wireless) and one or more networks 112 (such as the Internet, other wide area networks, local area networks, metropolitan area networks, cable television systems, satellite television systems, IPTV systems, etc.).
[0212] Unified TV application 202 is used to present a unified user interface 300 with recommended media content and to play media content provided by media content source 204 in response to the user's selection of recommended media content;
[0213] The local content casting application 902 is configured to be invoked by the unified TV application 202 in restricted mode to play media content selected according to the content selection criteria. The local content casting application 902 includes multiple media receiver modules 904, each media receiver module corresponding to a corresponding media content source 110, and is invoked to bypass the corresponding media player application 204 and play media content items provided by the corresponding media content source.
[0214] Media player application 204, which is executed to provide device-side functions for media display and user account management associated with the corresponding media content source 110; and
[0215] Device data 1526 stores at least the data associated with the control of media display on television device 102, including:
[0216] Projection settings 1528 are used to store information associated with the user account of the projection device application, including one or more of the following: account access information, device settings information (e.g., service tier, device model, storage capacity, processing power, communication capabilities, etc.) and information for automatic media display control;
[0217] Media player application settings 1530 are used to store information associated with the user account of media player application 204, including one or more of account access information, user preferences for media content types, and viewing history data; and
[0218] The Unified TV application setting 1532 is used to store information associated with the user account of the Unified TV application 202, including one or more of the following: account access information, user preferences for media content types, and viewing history data associated with the Unified TV application 202.
[0219] Each of the identified elements described above can be stored in one or more of the aforementioned storage devices and corresponds to an instruction set for performing the functions described above. The identified modules or programs (i.e., instruction sets) do not need to be implemented as separate software programs, processes, modules, or data structures; therefore, various subsets of these modules can be combined or otherwise rearranged in various embodiments. In some embodiments, memory 1506 may optionally store a subset of the identified modules and data structures. Furthermore, memory 1506 may optionally store additional modules and data structures not described above.
[0220] It should also be understood that although the terms first, second, etc., are used herein to describe various elements in certain circumstances, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of the various described embodiments, an audio feature of the first type can be referred to as an audio feature of the second type, and similarly, an audio feature of the second type can be referred to as an audio feature of the first type. Both the first type and the second type of audio feature are types of audio features, but they are not the same type of audio feature.
[0221] The terminology used in the description of the various embodiments described herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a” and “the” are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “comprising,” “including,” “comprises,” and / or “contains” as used in this specification specify the presence of the stated feature, integer, step, operation, element, and / or component, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0222] As used herein, the term "if" may be interpreted, depending on the context, as meaning "when" or "at" or "in response to determination" or "in response to detection" or "according to determination." Similarly, the phrase "if determination" or "if [the condition or event] is detected" may be interpreted, depending on the context, as "when determination" or "in response to determination" or "when [the condition or event] is detected" or "in response to the detection of [the condition or event]" or "according to the determination that [the condition or event] is detected."
[0223] Although the various accompanying figures show multiple logical stages in a specific order, stages that are not dependent on the order can be reordered, and other stages can be combined or decomposed. While some reorderings or other groupings are specifically mentioned, others will be obvious to those skilled in the art, and therefore the orderings and groupings given herein are not an exhaustive list of alternatives. Furthermore, it should be recognized that these stages can be implemented using hardware, firmware, software, or any combination thereof.
[0224] For purposes of explanation, the above description has been described with reference to specific embodiments. However, the above illustrative discussion is not intended to be exhaustive or to limit the scope of the claims to the precise forms disclosed. In view of the above teachings, many modifications and variations are possible. These embodiments were chosen in order to best explain the principles behind the claims and their practical application, thereby enabling others skilled in the art to best use the embodiments with various modifications suitable for the particular intended use.
Claims
1. A method for displaying a unified user interface, comprising: The media recommendation stream is obtained by the television device based on user activity data associated with the user account. The media recommendation stream includes an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items from different content providers that are currently unavailable for playback by the television device. Executing the unified TV application, the execution including displaying a unified user interface associated with the user account, the unified user interface including multiple tabbed interfaces; The selection of a first optional information item in an ordered sequence of optional information items is received from the family tabbed interface of the plurality of tabbed interfaces, the first optional information item being associated with a first upcoming media content item in an ordered set of upcoming media content items; Based on the received selection of the first optional information item, the first optional information item is included in a first cluster of multiple clusters, each cluster including a subset of an ordered sequence of the optional information items corresponding to an ordered set of the upcoming media content items in the media recommendation stream; and The multiple clusters are displayed in an upcoming tabbed interface of the multiple tabbed interfaces.
2. The method according to claim 1, wherein, The plurality of clusters also includes a second cluster, which includes: a second optional information item associated with a second upcoming media content item from a first content provider, and a third optional information item associated with a third upcoming media content item from a second content provider that is different from the first content provider.
3. The method according to claim 2, further comprising: Receive an instruction for a first user interaction with the second optional information item; In response to receiving the instruction from the first user interaction, information about the second upcoming media content item provided by the first content provider is displayed; Receive an instruction for a second user interaction with the third optional information item; as well as In response to the instruction received from the second user interaction, information about the third upcoming media content item provided by the second content provider is displayed.
4. The method of claim 2, further comprising: Receive user selection for the second optional information item; as well as In response to receiving the user's selection of the second optional information item, an options interface is displayed, the options interface including options for presenting a notification in the unified user interface when the second upcoming media content item from the first content provider becomes available.
5. The method of claim 2, further comprising: Receive user selection for the second optional information item; as well as In response to receiving the user's selection of the second optional information item, an options interface is displayed, the options interface including options for removing the second optional information item from the second cluster.
6. The method of claim 2, further comprising: Receive user selection for the second optional information item; as well as In response to receiving the user's selection of the second optional information item, an options interface is displayed, the options interface including options for adding the second upcoming media content item, represented by the second optional information item, to a queue of media content items for playback on the television device.
7. The method of claim 2, further comprising: Receive user selection for the second optional information item; as well as In response to receiving the user's selection of the second optional information item, a media player application corresponding to the first content provider is launched to display additional information about the second upcoming media content item.
8. The method of claim 2, further comprising: Receive search queries; The search results are presented in response to the search query, including a fourth upcoming media content item; Presenting the fourth upcoming media content item and the option to add the fourth upcoming media content item to the upcoming tabbed interface; as well as In response to a user selection to add the fourth upcoming media content item to the upcoming tabbed interface, the first cluster is updated to include the fourth upcoming media content item.
9. The method according to claim 1, in, The user activity data includes indications of user interactions with optional information items corresponding to upcoming media content items associated with a content provider linked to a media player application installed on the television device. as well as The display of the plurality of clusters in the upcoming tabbed interface further includes displaying additional upcoming media content items corresponding to the content provider within the clusters of the plurality of clusters.
10. The method according to claim 1, in, The multiple tabbed interfaces include user-configurable tabbed interfaces, which include media content items from specific content providers. The user activity data includes indications of user interactions with upcoming media content items associated with the specific content provider, included in the user-configurable tabbed interface; and The display of the plurality of clusters in the upcoming tabbed interface further includes displaying the upcoming media content items associated with the specific content provider within the clusters of the plurality of clusters.
11. The method according to claim 1, in, Displaying the multiple clusters in the upcoming tabbed interface further includes: The multiple clusters will be displayed in the non-focused area of the upcoming tabbed interface; Multiple selectable focus items are displayed in the focus area of the upcoming tabbed interface according to the time sequence; and A notification is displayed in the focus area when the first upcoming media content item from the content provider becomes available.
12. A television device, comprising: At least one processor; as well as A memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations, the operations including: A media recommendation stream is obtained based on user activity data associated with a user account, the media recommendation stream comprising: an ordered sequence of optional information items corresponding to an ordered set of upcoming media content items from different content providers that are currently unavailable for playback by the television device; Executing the unified TV application, the execution including displaying a unified user interface associated with the user account, the unified user interface including multiple tabbed interfaces; The selection of a first optional information item in an ordered sequence of optional information items is received from the family tabbed interface of the plurality of tabbed interfaces, the first optional information item being associated with a first upcoming media content item in an ordered set of upcoming media content items; Based on the received selection of the first optional information item, the first optional information item is included in a first cluster of multiple clusters, each cluster including a subset of an ordered sequence of the optional information items corresponding to an ordered set of the upcoming media content items in the media recommendation stream; and The multiple clusters are displayed in an upcoming tabbed interface of the multiple tabbed interfaces.
13. The television device according to claim 12, wherein, The plurality of clusters also includes a second cluster, which includes: a second optional information item associated with a second upcoming media content item from a first content provider, and a third optional information item associated with a third upcoming media content item from a second content provider that is different from the first content provider.
14. The television device according to claim 13, wherein, The operation further includes: Receive an instruction for a first user interaction with the second optional information item; In response to receiving the instruction from the first user interaction, information about the second upcoming media content item provided by the first content provider is displayed; Receive an instruction for second user interaction with the third optional information item; and In response to the instruction received from the second user interaction, information about the third upcoming media content item provided by the second content provider is displayed.
15. A non-transitory computer-readable storage medium comprising computer-executable instructions, said instructions, when executed by a processor of a television device, causing the television device to: A media recommendation stream is obtained based on user activity data associated with a user account, the media recommendation stream including: An ordered sequence of optional information items corresponding to an ordered set of upcoming media content items from different content providers that are currently unavailable for playback by the television device; Executing the unified TV application, the execution including displaying a unified user interface associated with the user account, the unified user interface including multiple tabbed interfaces; The selection of a first optional information item in an ordered sequence of optional information items is received from the family tabbed interface of the plurality of tabbed interfaces, the first optional information item being associated with a first upcoming media content item in an ordered set of upcoming media content items; Based on the received selection of the first optional information item, the first optional information item is included in a first cluster of multiple clusters, each cluster including a subset of an ordered sequence of the optional information items corresponding to an ordered set of the upcoming media content items in the media recommendation stream; as well as The multiple clusters are displayed in an upcoming tabbed interface of the multiple tabbed interfaces.
16. The non-transitory computer-readable storage medium according to claim 15, wherein, The plurality of clusters also includes a second cluster, which includes: a second optional information item associated with a second upcoming media content item from a first content provider, and a third optional information item associated with a third upcoming media content item from a second content provider that is different from the first content provider.
17. A method for displaying a unified user interface, comprising: Hosted user accounts linked to TV devices displaying a unified user interface; Associate the TV app, multiple media player apps, and multiple user apps with the user account; The upcoming media content item is selected based on the current unavailability of the upcoming media content item to be played back by the television device; Generate an ordered set of the upcoming media content items organized into multiple clusters, each cluster being associated with a category; The first category is determined to be associated with the first cluster among the plurality of clusters based on the user's interaction with the TV application; The first upcoming media content item is included in the first cluster based on the user's interaction with the TV application and the first upcoming media content item; as well as The television device is provided with an ordered sequence of optional information items corresponding to the ordered set of upcoming media content items for display in an upcoming tabbed interface among multiple tabbed interfaces of the unified user interface.
18. The method according to claim 17, in, The upcoming media content items include at least one media content item from a second content provider and at least one media content item from a third content provider; as well as The second content provider is different from the third content provider.
19. The method of claim 17, further comprising associating a virtual user domain with the user account.
20. The method of claim 17, further comprising providing at least one of the plurality of media player applications for use by the television device.
Citation Information
Patent Citations
Mixing media content items for display on focal area of networked television device
CN114424579A
