Automatic content recognition with live widget on independent displays

Abstract

A television system includes a first display configured to display streaming video content, and a second display configured to display secondary content related to the video content. The television system performs an automatic content recognition (ACR) analysis on the video content displayed on the first display, and based on the ACR analysis, identifies a first content item included in the video content displayed on the first display. While continuing to display the video content including the first content item on the first display in a continuous streaming mode, the television system displays first secondary content related to the first content item on the second display.

Description

AUTOMATIC CONTENT RECOGNITION WITH LIVE WIDGET ON INDEPENDENT DISPLAYSRELATED APPLICATIONS

[0001] The present application claims priority to U.S. Provisional Application Nos. 63 / 655,593 (filed 6 / 3 / 2024) and 63 / 655,595 (filed 6 / 4 / 2024), each of which is hereby incorporated by reference in its entirety.TECHNICAL FIELD

[0002] The present application relates to television displays and, more particularly, to a dualscreen television with integrated automatic content recognition for displaying live action widgets.BACKGROUND

[0003] The proliferation of streaming video applications and the availability of video content online have led to increased demands being placed on televisions to display traditional television content and make additional streaming or internet-based content available to television users.

[0004] Limitations of existing televisions, however, lead to clumsy control or presentation of interactive content over a program on the screen that is not relevant because nobody is present to watch it. In addition, screen overlays may interfere with viewing a currently displayed television program.

[0005] Existing televisions generally have incorporated a single display screen to present television content to users. Some televisions have allowed picture in picture for watching programs while navigating menus and split screen functionality that allows users to watch more than one television program at a time. However, this functionality has generally been limited to displaying programs and menus on the same screen at a reduced size. Televisions have also been arranged in arrays to allow single television sets to be physically placed in an array to each display part of a larger picture that is captured in the entire array.

[0006] There is a need for a television that allows for uninterrupted presentation of television programs or streaming content, while allowing viewers to access additional data related to the program or content.SUMMARY

[0007] An ACR module of a television system with two screens performs (702) an automatic content recognition (ACR) analysis on the video content displayed on the first display. Based on the ACR analysis, the ACR module identifies (704) a first content item included in the video content displayed on the first display. While continuing to display the video content including the first content item on the first display in a continuous streaming mode, the television system displays (706) first secondary content related to the first content item on the second display.

[0008] In some implementations, the secondary content is displayed in an interactive live action card on the second display and includes content corresponding to the first content item.

[0009] In some implementations, based on a second ACR analysis, the ACR module identifies a second content item included in the video content displayed on the first display after identifying the first content item; and while continuing to display the video content including the second content item on the first display in the continuous streamlining mode, the television system replaces the first secondary content related to the first content item with second secondary content related to the second content item on the second display.

[0010] In some implementations, the displaying of the first secondary content is subject to a timing threshold during which the ACR analysis performs successful identifications of the first content item. In some implementations, the displaying of the first secondary content is further subject to a consistency threshold during which the ACR analysis performs consistent identifications of the first content item until the timing threshold is reached.

[0011] In some implementations, based on a second ACR analysis, the television system determines a break in display of the video content on the first display and ceases displaying the first secondary content on the secondary display during the break in display of the video content on the first display.

[0012] In some implementations, based on a third ACR analysis, the ACR module determines that the break in display of the video content on the first display is over. The television system determines that the break did not reach a break time threshold; and based on the determination that the break did not reach the break time threshold, displays second secondary content on the second display related to a second content item displayed on the first display without waiting for a timing threshold.

[0013] In some implementations, the video content is a movie or television show, and the content item is a character in a scene of the movie or television show currently being displayed on the first display. In some implementations, the first secondary content is a description of the character in the scene of the movie or television show currently being displayed on the first display.BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above described features and advantages of the present disclosure will be more fully appreciated with reference to the following figures.

[0015] Figure 1 depicts a television system that integrates two distinct screens and concurrent functionality' in accordance with some implementations.

[0016] Figure 2 depicts a functional block diagram of a television system that integrates two distinct screens and concurrent functionality' in accordance with some implementations.

[0017] Figures 3A-3D depict an example live action card sequence for a television system having two distinct screens in accordance with some implementations.

[0018] Figure 4 depicts example live action card elements for a television system having two distinct screens in accordance with some implementations.

[0019] Figure 5 depicts a live action card content process flow for a television system having two distinct screens in accordance with some implementations.

[0020] Figure 6 depicts a method flow chart for displaying live action card content on a secondary display related to video content streaming on a primary display for a television system having two distinct screens in accordance with some implementations.

[0021] Figure 7 depicts a method flow chart for an automatic content recognition process used to display live action card content on a secondary display related to video content streaming on a primary display for a television system having two distinct screens in accordance with some implementations .

[0022] Figure 8 depicts a functional block diagram of an event' ACR system corresponding to flow diagram 700 of Figure 7 in accordance with some implementations.DETAILED DESCRIPTION

[0023] In some implementations, a presence sensor on the front of a television is used to determine the presence of viewers and / or number of viewers. The sensor may be a time-of-flight (ToF) sensor, an infrared (IR) sensor, a thermal sensor, a millimeter wave sensor, an ultrawideband (UWB) sensor, an ultrasonic sensor, a WiFi sensor, a Bluetooth Low Energy (BLE) sensor, or a radar-based sensor. The presence of viewers may be used to automatically turn on and off the television. Once the number of viewers is determined, the television may make automatic changes to the configuration, programming, content and / or advertising for the number of viewers. Hie processing to determine the number of persons may be performed locally on the television based on the radar to preserve such information locally for immediate use.

[0024] The systems and methods described herein are preferably adapted to two screen televisions where the content for one or both screens is selected based on the presence of persons detection information, and the content for the second may be further selected by the content on the first screen. However, the system and methods may be applied to televisions with only one screen, or more than two screens.

[0025] Figure 1 depicts an illustrative television system 100 that integrates two distinct screens and concurrent functionality In some implementations. Referring to Figure I, the television includes an overall housing and a primary display 110 and a secondary’ display 130. Tire screens may be separated by an optional sound bar 120. Alternatively, the screens may be separated by a physical divider or placed adjacent to one another. The secondary display may be portioned into areas where the screen output is determined by widget programs 140 that present information, interactive or otherwise, to users. In some implementations, the television further includes a presence sensor 150 and / or a microphone 160.

[0026] In some implementations, the secondary television screen 130 is approximately 1 / 4 to 1 / 3 the height of the primary television screen 110, which preferably has an aspect ratio of 16:9. This allows a television viewer to watch a standard 16:9 television screen while simultaneously watching a smaller, secondary display for multitasking. Additionally, while the primary display is off, the secondary display may remain on and display text, graphics, advertising, video, and / or audio. This arrangement facilitates providing a full range of interactive content, control, andfeatures to users via the provision of applications that may control either screen or both screens simultaneously. Such applications enable the linking of content, control, and features between the two screens and ancillary devices such as a sound bar, which may also be integrated into the television.

[0027] In some implementations, the integrated television screens may comprise separate television panels integrated into a single television, with or without a soundbar. In other implementations, for example, a single 4:3 panel may be configured with a physical screen divider and hardware and software provisioning to divide the television into two separate integrated screens, hi some implementations, HDMI ports may deliver video to the primary display only. In other implementations, the HDMI ports may deliver video to the primary and secondary displays.

[0028] Figure 2 depicts a functional block diagram of a television that integrates two distinct screens and concurrent functionality in accordance with some implementations. Referring to Figure 2, a television system 100 incorporates a processor 210 coupled with a memory 220, HDMI ports 230, an ATSC or PAL tuner 240, an optional presence sensor 150, an optional microphone 160, an optional soundbar 120, a connection to the internet 250, and two distinct screens 110 and 130 as described above. The memory' 220 may store programs that include program instructions that are executed by the processor to enable the various functionalities of the television system 100. The memory 220 may include, for example, an application programs module 221, a screen configuration module 222, user profiles 223, a closed captioning module 224, a person detection module 225, and / or a remote control module 226. The memory 220 may include modules in addition to, or instead of, the modules shown in Figure 2, related to processing one or more operations described herein.

[0029] The memory 225 also includes an automatic content recognition (ACR) module 227 configured to perform ACR on the content currently being presented on the primary display 110, and a live action card (LAC) module 228 configured to obtain and present content related to the primary content on the secondary display 130 in parallel with the primary content on the primary display 110.

[0030] The HDMI ports enable A / V devices 230 to be connected to the television, including DVD players, DVRs, sound bars, streaming boxes, A / V Receivers, gaming consoles and otherequipment. ATSC or PAL tuners 240 may be incorporated into the television to allow the television to receive over the air or certain cable broadcasts and present them on the main screen or on the secondary display.

[0031] An optional microphone 160 may be included in the television to allow the user to provide spoken commands to the television, to allow for video conferencing, and / or to allow other audio visual applications. An optional presence sensor 150 may also be provided to facilitate functionality such as recognizing gestures and motion recognition, among other features. The screens are distinct and render images corresponding to content from the HDMI ports 230, from the tuners 240, from the internet 250, and / or from streaming or other interconnected devices. In addition, the content of the screens may be determined by application programs or any of the other programs or modules stored in the memory 220 and executed by the processor 210. The speakers and / or optional soundbar 120 are used to provide audio output corresponding to content displayed on the screens or enabled through the application programs or other programs provided on the television. The television may also incorporate an RF receiver or IR port for receiving signals from a remote control used to control the television.

[0032] The processor 210 may be a single microprocessor, multiple processors, or a processor and a coprocessor. In some implementations, a primary microprocessor may be used to render and operate the user interface while a second processer maybe used to decode video, for example H.264 format outputting a signal via HDMI. The processor(s) may support all functionality needed to operate the display screens of the television, and synchronize images with audio output, including rendering, video decoding, audio decoding, audio visual synchronization control, motion estimation and motion compensation, picture quality, time stamp normalization, frame rate control, and over the air updates. In addition, the processor(s) 210 execute program instructions from memory to enable applications to be presented on one or both screens of the television, and to permit use of the speakers, microphone, internet connection, remote control, and two-way communication with ancillary devices connected to the television, such as content streaming hardware. In some implementations, the processor 210 may be an application processor designed specifically for smart display applications such as the A311D2 processor, and may include, for example, CPU / GPU subsystems, video codecs, graphics subsystems, video engines, video / graphics output pipelines, HDMI receiver ports, demultiplexers for broadcast and streaming video, digital signal processors (DSPs) forprocessing audio, peripheral interphases such as for Ethernet, USB, SDIO 3.0, eMMC 5.1, SDIO / SD card controller, UART, 12C, high-speed SPI PWMs and an IR blaster. The processor may be distributed or a system on a chip and may interface with additional memory and components of the television.

[0033] The ACR module 227 is configured to perform ACR on the content currently being presented on the primary display 110. The ACR module 227 identifies and analyzes content being displayed on the primary display 110 (referred to herein as first content or primary content), without requiring manual input from the user. The ACR module 227 may operate using various methods, including video fingerprinting, audio watermarking, and / or metadata analysis. In some implementations, the ACR module 227 continuously captures video and / or audio samples of the displayed content. These samples are then processed locally (e.g., by processor 210 ) or sent to a remote server, where they are compared against a reference database of known content. Upon identifying a match, the system can retrieve contextual information, such as the title of the program, broadcaster, viewing time, and associated metadata. The ACR module 227 performs the ACR analysis while the primary content is being played, streamed, and / or presented (whatever the case may be) on the primary display 110. Stated another way, the content recognition happens in real-time, or near real-time, while the content continues to play. Example content includes movies, television shows, sports, and any other media that users may wish to consume on a television. Example content items identified by the ACR module 227 include the identity of the movie or show being played, one or more actors or characters in a current scene, music being played in a current scene, and any other item of content currently being presented on the primary display 110.

[0034] The LAC module 228 is configured to obtain and present content related to the primary content (referred to herein as secondary content, live action cards, and widgets) on the secondary display 130 while the primary content to which the secondary content corresponds is still being played, streamed, and / or presented (whatever the case may be) on the primary display 110. In some implementations, the secondary content is displayed as a live action card in one or more of the widget programs 140 (see Figure 1) presented on the secondary display 130. Since the secondary content is displayed on the secondary' display 130 at the same time the corresponding primary' content is displayed on the primary display 110, the secondary contentmay be referred to as live content, or live action content. Thus, the card displaying such content may be referred to as a live action card.

[0035] Figures 3A-3D depict an example live action card sequence for a television system having two distinct screens in accordance with some implementations. In Figure 3A, a movie is streaming on the primary display 110 while a live action card 140 includes the movie title, description, and other secondary content describing the movie on the secondary display 130. hi Figure 3B, a user interacts with the live action card by causing various options (e.g., “General Info” and “Top Cast”) to be displayed in the live action card, which in turn causes the secondary content to temporarily move out of the way. Upon selecting “Top Cast,” the live action card 140 in Figure 3C displays secondary content describing the character who is depicted in the foreground of the scene on the primary display 110. The secondary content 140 is displayed while the scene continues to play out. As different characters appear on the screen, the live action card automatically and dynamically updates, as in Figure 3D, in which a new character has come into view on the primary display 110, thereby causing related secondaiy content (a description of this new character) to be displayed in the live action card 140 on the secondary display 130.

[0036] In general, live action cards provide additional information on the secondary’ display 130 related to the media users are currently watching on the primary display 110. Whenever users watch media like movies, television shows, and sports, the secondary’ content automatically displays on the secondaiy display 130. Similar to other widgets, users may utilize a remote control to collapse or expand the live action card widget as needed.

[0037] In some implementations, the live action card is automatically displayed or updated upon reaching a timing threshold (e.g., two minutes) of continuous playback during which the ACR module 227 detects / identifies the primary content being played on the primary display" 110. By not immediately" causing the live action card to display or update, this ensures higher accuracy and relevance of the data actually displayed in the live action card, which has the technical effect of saving computational resources by only causing the correct data to be displayed at the correct times. In some implementations, if the ACR module 227 detects advertising content, no matches, or multiple matches at the same time, this resets the timing threshold.

[0038] In some implementations, the timing threshold defines a waitin gperiod, and the live action card is automatically displayed or updated upon reaching the timing threshold and only if a consistency threshold is met during the waiting period. For example, during the two minutes the ACR module 227 is detecting / identifying the primary content, the detections must reach a treshold (e.g., 90%) of consistent matches. By not causing the live action card to display or update unless the consistency threshold is met, this ensures higher accuracy and relevance of the data actually displayed in the live action card, which has the technical effect of saving computations resources by only causing the most useful data to be displayed at the most relevant times.

[0039] In some implementations, no live action card data is displayed when the ACR module 227 does not detect / identify content on the primary display 110 or when an error occurs while retrieving information.

[0040] In some implementations, when the ACR module 227 detects a change of content or is unable to match anymore after a timing threshold (e.g., two minutes) and / or a consistency threshold is unmet (e.g., <90% match consistency), the LAC module 228 stop displaying the live action card.

[0041] In some implementations, if the ACR module 227 detects advertising data, the timing threshold is reset. This is to support linear TV (also known as traditional TV, which refers to the broadcast of scheduled programming through cable, satellite, or over-the-air networks) and advertising-based video on demand (AVOD) where content will have ad breaks. By reseting the timing threshold when advertising data is detected, this ensures relevant data is not lost, which has the technical effect of increasing efficiency of computational reserources by preventing ACR processes from needlessly repeating when relevant data is already obtained (e.g., upon returning to the main content when the advertising is finished).

[0042] In some implementations, the live action card is displayed in the first visible / leftmost user visible position 140 on the secondary display 130. In these implementations, when live action cards are entered into the home feed, other active cards are pushed to the right. Thus, in these implementations, the live action card widget is in the first position of the array. In some implementations, it does not matter if the user is actively using the remote control or not; the position for the live action card widget 140 is absolute.

[0043] In some implementations, the live action card widget 140 is shown on the secondary' display 130 as a single widget with multiple cards inside that rotate the available information. The dynamic home feed represented by other widgets displayed on the secondary display 130 remains unaffected by the live action card widget.

[0044] In some implementations, the first time the live action card widget starts running, it takes the first spot in the home feed displayed on the secondary display 130. In some implementations, the order of the widgets is determined by a hierarchy of the information, starting with the overall information, and cast. In some implementations, one or more other widgets, such as an ad container widget, remain unchanged on the secondary display 130 and continue to follow their own behavior rules.

[0045] Figure 4 depicts example live action card elements for display by the LAC module 228 on the secondary display 130. A movie information card may display a movie poster image, movie title, and chips containing movie duration, rating, and other information while in a condensed view. The movie information card may additionally display a director name and a movie description while in an expanded view. A TV show information card may display a TV show image, show name, and chips containing number of seasons and release year while in a condensed view. The TV show information card may additionally display a director name and number of seasons while in an expanded view. A top cast card may list the top five people in the cast array for the movie currently being streamed. A move cast card may display an actor photo, full name, and character name. A TV show cast card may display an actor photo, full name, and character name, show presenter, or guest name.

[0046] Figure 5 depicts a live action card content process flow for a television system having two distinct screens in accordance with some implementations. Each source of the streaming content that may be displayed on the primary display 110 also provides metadata 502 / 504 / 506. Tire ACR module 227 translates the metadata to a widget 508 / 510 / 512 including secondary content describing (or otherwise related to) the currently playing primary content on the primary display 110. The ACR module 227 normalizes the widget payload 514 and sends (516) the widget payload data to the secondary display 130 for display to the user while the primary content continues to play on the primary display 110.

[0047] Figure 6 depicts a method 600 for displaying live action card content on a secondary display related to video content streaming on a primary display for a television system having two distinct screens in accordance with some implementations. While the primary display 110 displays (602) a first portion of primary content including a first content item (e.g., a character in a currently playing scene, as in Figure 3C), the ACR module 227 identifies the first content item and the LAC module 228 causes first secondary content related to the first content item (e.g., a description of the actor playing the character) for display on the secondary display 130. Steps 602 and 604 happen hi parallel; in other words, the secondary content displays on the secondary display 130 while the first portion of primary content continues to play on the primary display 110.

[0048] While the primary content continues to play on the primary display 110, a second portion of the primary content (e.g., the next scene) including a second content item (e.g., another character, as in Figure 3D) displays (606) on the primary display 110, while the ACR module 227 and LAC module 228 work together to display (608) second secondary content (e.g., a description of the actor playing the other character, as in Figure 3D) on the secondary display 130.

[0049] Eventually, display of the primary content is suspended (610) from being displayed on the primary display 110, due to, for example, insertion of an advertisement. At this time, the secondary content is suspended (612) from being displayed on the secondary’ display 130. While a third portion of the primary content including a third content item is displayed (614) on the primary display 110 (e.g., the next scene following the advertisement including a third character), the ACR module 227 and LAC module 228 work together to display" (616) third secondary content (e.g., a description of the actor playing the third character) on the secondary display 130.

[0050] Figure 7 depicts a method 700 for an automatic content recognition process used to display live action card content on a secondary display related to video content streaming on a primary display for a television system having two distinct screens in accordance with some implementations.

[0051] An ACR module of a television system with two screens performs (702) an automatic content recognition (ACR) analysis on the video content displayed on the first display. Based onthe ACR analysis, the ACR module identifies (704) a first content item included in the video content displayed on the first display. While continuing to display the video content including the first content item on the first display in a continuous streaming mode, the television system displays (706) first secondary content related to the first content item on the second display.

[0052] In some implementations, the secondary' content is displayed in an interactive live action card on the second display and includes content corresponding to the first content item.

[0053] In some implementations, based on a second ACR analysis, the ACR module identifies a second content item included in the video content displayed on the first display after identifying the first content item; and while continuing to display the video content including the second content item on the first display in the continuous streamlining mode, the television system replaces the first secondary content related to the first content item with second secondary content related to the second content item on the second display.

[0054] In some implementations, the displaying of the first secondary content is subject to a timing threshold during which the ACR analysis performs successful identifications of the first content item. In some implementations, the displaying of the first secondary content is further subject to a consistency threshold during which the ACR analysis performs consistent identifications of the first content item until the timing threshold is reached.

[0055] In some implementations, based on a second ACR analysis, the television system determines a break in display of the video content on the first display and ceases displaying the first secondary content on the secondary display during the break in display of the video content on the first display.

[0056] In some implementations, based on a third ACR analysis, the ACR module determines that the break in display of the video content on the first display is over. The television system determines that the break did not reach a break time threshold; and based on the determination that the break did not reach the break time threshold, displays second secondary content on the second display related to a second content item displayed on the first display without waiting for a timing threshold.

[0057] In some implementations, the video content is a movie or television show, and the content item is a character in a scene of the movie or television show currently being displayedon the first display. In some implementations, the first secondary content is a description of the character in the scene of the movie or television show currently being displayed on the first display.

[0058] Figure 8 depicts a functional block diagram of an event / ACR system corresponding to the flow diagrams in Figures 5-7 in accordance with some implementations.

[0059] Reference have been made in detail to various implementations, examples of which are illustrated in the accompanying drawings. In the above detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention and the described implementations. However, the invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the implementations.

[0060] It will be understood that, although the terms “first,” “second,” etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first device could be termed a second device, and, similarly, a second device could be termed a first device, without changing the meaning of the description, so long as all occurrences of the first device are renamed consistently and all occurrences of the second device are renamed consistently. The first device and the second device are both devices, but they are not the same device.

[0061] The terminology used herein is for the purpose of describing particular implementations only and is not intended to be limiting of the claims. As used in the description of the implementations and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. For example, “A, B, and / or C” means: A only; B only; C only; A and B; A and C; B and C; or A, B, and C. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0062] As used herein, the term “if’ may be construed to mean “when” or “upon” or “in response to determining” or “in accordance with a determination” or “in response to detecting,” that a stated condition precedent is true, depending on the context. Similarly, the phrase “if it is determined [that a stated condition precedent is true]” or “if [a stated condition precedent is true]” or “when [a stated condition precedent is true]” may be construed to mean “upon determining” or “in response to determining” or “in accordance with a determination” or “upon detecting” or “in response to detecting” that the stated condition precedent is true, depending on the context.

[0063] The foregoing description, for purpose of explanation, has been described with reference to specific implementations. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The implementations were chosen and described in order to best explain the principles of the invention and its practical applications, to thereby enable others skilled in the art to best utilize the invention and various implementations with various modifications as are suited to the particular use contemplated.

Claims

CLAIMSWhat is claimed is:

1. A television system, comprising: a first display configured to display streaming video content; a second display configured to display secondary content related to the video content, wherein the second display is physically distinct from the first display; and one or more processors and memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions that cause the one or more processors to: perform an automatic content recognition (ACR) analysis on the video content displayed on the first display; based on the ACR analysis, identify a first content item included in the video content displayed on the first display; while continuing to display the video content including the first content item on the first display in a continuous streaming mode, display first secondary content related to the first content item on the second display.

2. The television system of claim 1, wherein the secondary content is displayed in an interactive live action card on the second display and includes content corresponding to the first content item.

3. The television system of claim 1, wherein the instructions further cause the one or more processors to: based on a second ACR analysis, identify a second content item included in the video content displayed on the first display after identifying the first content item; and while continuing to display the video content including the second content item on the first display in the continuous streamlining mode, replace the first secondary content related to the first content item with second secondary content related to the second content item on the second display.

4. The television system of claim 1, wherein the displaying of the first secondary content is subject to a timing threshold during which the ACR analysis performs successful identifications of the first content item.

5. The television system of claim 4, wherein the displaying of the first secondary content is further subject to a consistency threshold during which the ACR analysis performs consistent identifications of the first content item until the timing threshold is reached.

6. The television system of claim 1, wherein the instructions further cause the one or more processors to: based on a second ACR analysis, determine a break in display of the video content on the first display; and cease displaying the first secondary content on the secondary display during the break in display of the video content on the first display.

7. The television system of claim 6, wherein the instructions further cause the one or more processors to: based on a third ACR analysis, determine that the break in display of the video content on the first display is over; determine that the break did not reach a break time threshold; and based on the determination that the break did not reach the break time threshold, display second secondary content on the second display related to a second content item displayed on the first display without waiting for a timing threshold.

8. The television system of claim 1, wherein the video content is a movie or television show, and the content item is a character in a scene of the movie or television show currently being displayed on the first display.

9. The television system of claim 8, wherein the first secondary content is a description of the character in the scene of the movie or television show currently being displayed on the first display.

10. A non-transitory computer readable storage medium storing one or more programs configured for execution by one or more processors, the one or more programs including instructions that cause the one or more processors to perform the functions of any of claims 1-9.

Images