System and method for ingesting and displaying alternative video and / or audio media synchronized with the display of linear video and audio content based on periodic evaluation of relevant environmental parameters, and maintaining the quality and integrity of the ingested content

Abstract

The present invention refers to a system implemented in a digital TV receiver that provides broadcasters with a secure method for ingesting alternative video and / or audio media and replacing portions of the main video and / or audio with the goal of customizing the experience of identified consumers during their digital video and / or audio consumption experience. The system seeks to ensure the best possible experience for consumers without experiencing interruptions, lack of fluidity, or inconsistency in the playback of the alternative video and / or audio. The system provides a method for persistently verifying the conditions suitable for playback of the alternative video and audio.

Description

[Technical Field]

[0001] The present invention relates to a system for ingesting alternative video and / or audio content (hereinafter referred to as AVA) obtained from sources such as the Internet, local storage, or a private local network in a synchronized digital TV receiver that displays main video and / or audio content (hereinafter referred to as MVA), which is characterized as content of linear origin and characteristic obtained from a digital TV signal transmission such as a terrestrial, satellite, or cable TV channel.

[0002] The present invention also relates to a method for implementing the above system in the above TV receiver, which method comprises a synchronized, dynamic, segmented replacement of sections of MVAs, called programming blocks, with equivalent sections of AVAs, which replacement allows broadcasters to personalize content at any desired level of segment granularity, down to the level of a single consumer or viewer according to their criteria.

[0003] It is particularly noteworthy that, in accordance with the system and objectives of the present invention, the broadcasting station responsible for transmitting the MVA must inform the linear signal receiver (terrestrial, satellite, or cable) where the AVA will be obtained, at what point in the display time flow such content will be obtained, and at what point in time the AVA will be displayed in place of the MVA, so that the AV can be prepared for display, and the content display is adjusted based on an evaluation of the receiver operation at that time. Such evaluation of the receiver operation occurs at different times and takes into account several conditions and parameters, including CPU (Central Processing Unit) usage, amount of RAM resources, amount of local storage memory resources, available Internet bandwidth, and the resolution of the candidate AVAs to be played.

[0004] However, it should be noted that the broadcaster is also responsible for transmitting in the digital signal an interactive application that runs on the receiver when the viewer tunes to the broadcaster's channel, during which time this application performs the interpretation and synchronization control of the programming blocks.

[0005] The system of the present invention has, as a principle, a display transition control that ensures synchronization between the display of MVAs and AVAs, reduces the user's perception of alternation between sources, and ensures continuity and fluidity of the display of audio and video content as much as possible.

[0006] Additionally, the present invention relates to displaying content on devices including "smart receivers," which are broadly considered to be any digital TV receiver with Internet connectivity and the ability to load and run software applications. [Background technology]

[0007] As is well known, a digital TV receiver is a device that can receive, decode, and display on a monitor screen digital signals transmitted by various broadcast stations using terrestrial, cable, or satellite signals. Such devices can be fixed (whether integrated into a TV set), portable, or mobile.

[0008] Smart receivers are now widely available worldwide in various formats, types, and models, including "set-top box" decoders (STBs), smart TVs, and mobile receivers such as mobile phones capable of capturing digital TV signals. Smart receivers not only provide traditional television broadcast functionality in the form of linear programming channels, but also offer integrated Internet and web access resources. Smart receivers are thus an example of technological convergence between computers and television sets, and thus also encompass Internet-connected devices that use a television screen as a display device. Software components or applications running on smart receivers can be preloaded on the device or installed and updated online on demand via an app store, similar to what is done with modern handheld devices such as mobile phone devices.

[0009] Traditionally, the presentation of linear origin MVA content, for example from a digital TV broadcaster, has not provided for the alternation of content between MVA and AVA from another source other than the broadcast TV signal, because, unlike the traditional process described above, this operation is performed dynamically and internally in the digital receiver. This transition poses a high risk of causing a loss or failure of synchronization between the sources, resulting in an unpleasant and incomprehensible experience for the consumer / viewer. It is important to note that the fluid experience of consumers of broadcast services is generally considered reliable in its historical, fundamental, and differentiating characteristics by all broadcasters, in contrast to the experience that consumers of primarily online streaming services already have and are expected to wait for at some point before experiencing disruption.

[0010] It should also be noted that in some regions and countries where the terrestrial TV broadcast receiver base has already been digitized, it is necessary to maintain the compatibility of all installed digital receivers with the requirements contained in the respective digital broadcasting standards, and that from the time the first receivers appear on the market, updates, modifications and new implementations of features of the data broadcast by broadcasters must respect and ensure compatibility with the legacy installed equipment base.

[0011] Patent Literature 1 (PTL 1) describes a method for inserting end-user-based customized commercial advertisements into hybrid or integrated terminals to support broadband and broadcasting based on the presence of SCTE-35 markers (ANSI / SCTE 35 2013 "Digital Program Insertion Cueing Message for Cable") in the original content stream. Displaying advertisements in hybrid terminals connected to both the Internet and a broadcast network, such as smart televisions (TVs), is described. In particular, the described teachings are directed to a system and method for cuing viewers to break schedule times and content, such as customized advertisements, in a hybrid terminal setting that receives a break schedule via a TV broadcast network by replacing markers traditionally used by broadcasters to cue commercial breaks with one or more tables embedded in the television content transport stream.

[0012] In the technology described in this document, ad insertion markers present in a broadcast content transport stream are replaced with one or more service information (SI) tables containing information corresponding to the replaced markers. The transport stream containing the tables is then delivered to a hybrid terminal. The SI table may include a file (manifest) to flag upcoming ad schedules. The manifest may provide information about the source, allowing the hybrid terminal to retrieve customized ads from this source and identify available break times in the transport stream for inserting the retrieved ads. To enable the hybrid terminal to display customized ads to viewers, the SI table may identify an Ad Decision Server (ADS), from which the hybrid terminal may request customized ads to be displayed to viewers watching a TV program. Such ads are retrieved based on the original break schedule, inserted into the break schedule, and replaced.

[0013] This technique has a notable drawback when the structure of a signal generated by a broadcaster specifies the need to insert special tables in addition to the tables already expected by the digital TV receiver. Such a technique presumes that the step of inserting these special tables was performed by the broadcaster and relies on the precise implementation of special controls to avoid potential compatibility issues when decoding the digital signal data in the digital TV receiver's native system. Unlike cable and satellite TV systems, which allow receiver terminals to be customized according to any proprietary technology or method, digital terrestrial TV receivers (free-to-air / broadcast TV) available on the market, regardless of manufacturer or model, have a legacy that requires backward compatibility. Such receivers must strictly adhere to a single standard, and within this standard, the native operating system included in such receivers may encounter problems when attempting to decode special information (e.g., tables) added outside the scope of the standard's recommended requirements for receiving and decoding digital terrestrial TV signals (free-to-air TV).

[0014] Another significant flaw in the techniques described in the aforementioned documents is that these tables are constructed based on the presence of markers, which necessarily follow the techniques specified in the SCTE-35 standard (ANSI / SCTE 35 2013 "Digital Program Insertion Cueing Message for Cable") originally used in American cable TV. If broadcasters in a particular region or country do not use such standards, the dependency on the presence of these markers, which must be inserted by the broadcaster after the creation of the original stream containing the digital TV content, may represent an insurmountable or difficult-to-solve specification for the implementation of the techniques described in those broadcaster settings.

[0015] Another limiting problem demonstrated by the presented technology lies in the fact that it is intended to replace only certain types of broadcaster-generated content, such as commercial inserts, called interstitial breaks, scheduled within the original content of a TV broadcaster on a particular broadcast channel. The overall context of the presented system refers to the problem of advertisements generated in broadcaster programming, their generation, their replacement and the control of this replacement process.

[0016] The presented technology is notably completely silent on the issue of consumer experience, which is considered essential for all broadcasters. For those skilled in the art, the cited documents make it clear that their teachings are based on the existence of time control mechanisms. The presentation of the above technology does not describe a framework, method, or basis that can solve problems such as delays (commonly found during the display of live content, especially sports programming whose duration cannot be specified in advance), display failures, timeless changes, and several other similar problems known within broadcast content display settings.

[0017] Thus, the system for ingesting alternative video and / or audio content (AVA) according to the present invention surprisingly observes all the important features and particularities mentioned above and solves the problems of the systems proposed by the prior art in an advantageous and widely achievable manner. [Prior art documents] [Patent documents]

[0018] [Patent Document 1] No. US9479801B2 [Patent Document 2] BRPI0806069A2 (Karaoke) Summary of the Invention [Means for solving the problem]

[0019] As used herein, terms such as "smart receiver," "digital TV receiver," "integrated receiver," and "IBB receiver" (integrated broadcast broadband) may be used interchangeably in the following description to refer to a device, regardless of format or model, that integrates support for connection to a digital TV signal broadcast network or a broadband network with Internet access.

[0020] The system described herein is based on the time synchronization method described in patent application WO 2005 / 024990, owned by the same author, and complements it to extend its range and provide dynamic operation, subject to the conditions of use of the receiver.

[0021] More specifically, but not by way of limitation, certain embodiments of the present invention are based on systems and methods for synchronizing and rotating the timing and display of programming block content, such as customized advertisements, segmented programming for specific geographic regions, audiences, etc., on such smart receivers.

[0022] For example, modern video and audio streaming applications providing content on demand (VOD) expect the consumer / viewer to be identified only by the application, typically using parameters such as user / password and / or authentication tokens. It is also expected that these applications will be compatible with the aforementioned smart digital TV receivers and therefore be able to be installed on said digital TV receivers.

[0023] It is further assumed that the consumer / viewer, identified only via the application, is linked to the linear video / audio source - MVA - that is being displayed at the time, and thus the replacement of MVA with AVA, and the subsequent reverse operation of replacing AVA with MVA, is performed in a precise manner, and that said application is properly authorized to perform the replacement of MVA with AVA and vice versa.

[0024] A system according to the present invention is provided for enabling digital TV sets to have broadband internet connectivity as well as internal and temporary media storage capacity.

[0025] The end result is that the system of the present invention allows for unlimited and simultaneous broadcast content to multiple consumers / viewers, merging segmented or customized content in a secure manner as transparently as possible to the audience.

[0026] [Mode for Carrying Out the Invention] The following description sets forth certain details and particularities of the present invention to provide a thorough understanding of the present invention. However, those skilled in the art will appreciate that the teachings of the present invention can be embodied in different scenarios in which these specific details are not employed. Furthermore, certain well-known methods, components, and procedures have not been described in detail in the context of the illustrated settings so as not to deviate from the scope of the present invention. As noted above, the present invention is primarily described in the context of television programming distributed over terrestrial broadcast networks, i.e., free / broadcast TV, but it should be understood that the teachings contained herein can be used in any other broadcast setting, such as cable TV, satellite, or digital radio, and various types of audiovisual content.

[0027] For the purposes of the present invention, in the specification given below, the following should be considered. The term "digital TV receiver" should be understood as any device that supports and executes digital files and is able to receive, decode and display on a monitor or speaker system digital TV signals transmitted by terrestrial, satellite or cable TV broadcasters. Such devices may be fixed, portable or mobile, integrated or not in a TV set. - The term "MVA - Main Audio and Video Content" should be understood to include main content that proceeds without any intervention or control by the user. Examples of linear multimedia content include, but are not limited to, an uninterrupted TV signal. The term "AVA - Alternative Video and Audio Content" should be understood to include content that requires intervention or control by the system described herein in order to proceed, i.e., that requires the interpretation of a request from the broadcaster in order to operate.

[0028] The present invention therefore relates to a system for ingesting alternative video and / or audio content synchronized with a display stream of linear original feature video and audio content, for example in a digital TV receiver, the digital TV receiver being controlled by an agent providing such content, for example a broadcaster.

[0029] Additionally, the system of the present invention implements a method for interpreting requests / signals from broadcasters via, but not limited to, known "system event" techniques, which signaling is interpreted by the system as a request to replace linear content (MVA) with alternative (AVA) features.

[0030] Additionally, the system of the present invention includes a mechanism for identifying programming blocks and data synchronization, which uses a new technique for describing future programming blocks and synchronizes data with multimedia broadcast content, using concepts described in the aforementioned US Patent Application Publication No. 2007 / 0129999, owned by the same author.

[0031] The purpose of this system mechanism of the present invention is to provide a digital TV receiver with knowledge of the structure of a programming block that may be displayed at any time in the future and be prepared to perform an action at the time the block is displayed.

[0032] The most typical application of this technology proposed herein is the replacement of linear content originating from a broadcast signal (MVA) with non-linear content (Alternative Video and Audio, or AVA). For this, the receiver needs to know in advance the programming blocks to be replaced in order to correctly list the AVA content and make the necessary preparations to play such AVA content so as not to disrupt the viewer's experience, e.g., so that the viewer does not observe interruptions in the playback of the AVA content or degradation / changes in the quality of the AVA content. Also, importantly, the AVA content must be compatible with the replaced MVA content, especially in terms of time, i.e., the time size of the blocks must be the same and they must belong to the same advisory (or content) rating, i.e., the two contents must have the same advisory rating.

[0033] The interpretation of programming blocks and data synchronization is performed by an interactive application broadcast over DSMCC. This application is intended to (i) interpret the DSMCC stream transmitted with synchronization events, and (ii) interpret the programming block descriptors broadcast, e.g., as "synchronization events." Programming blocks can be transmitted at a similar or lower update rate than "synchronization events."

[0034] The interactive application sends synchronization events and programming block descriptors to the decision-making system, which, along with data from the interactive application, is fed to the decision-making system by the digital TV receiver's data collection mechanism to determine (i) whether any content described in the MVA content descriptor needs to be replaced, and (ii) whether the content replacement can be smoothly performed without degrading the viewer's TV viewing experience.

[0035] When the decision-making device identifies that MVA content should be replaced with AVA content, the system of the present invention drives the video selector and decoder to perform the content switch.

[0036] The broadcast transport stream of programming blocks can be broadcast to digital TV terminals according to the teachings discussed in this invention. It should be noted that the teachings of this invention are applicable to, but not limited to, settings in which the transport stream is distributed over a television broadcast network conforming to a digital terrestrial TV standard. This distribution requires that the hierarchical structure of the standardized transport stream is not altered in any way, since no structural changes to the broadcast signal that would cause a deviation from the requirements of a particular digital terrestrial TV standard are required, thereby ensuring that the broadcast signal remains fully functional on all equipment available on the market.

[0037] However, those skilled in the art will readily appreciate that the teachings of the present invention may be embodied without limiting their application to terrestrial digital TV broadcast settings, and in fact are equally applicable to transport streams provided by television broadcast networks via other transmission means, e.g., satellite, cable, IPTV, etc.

[0038] Similarly, while the teachings of the present invention describe a digital TV transmission and reception setting, those skilled in the art will note that the scenario can be easily extended to any digital broadcast transmission and reception setting, including digital TV and / or radio. [Brief explanation of the drawings]

[0039] [Figure 1] FIG. 1 is a diagram showing a system according to the present invention. [Figure 2] FIG. 2 illustrates a module for inserting and replacing linear content with non-linear content. [Figure 3a] FIG. 3a is a flowchart of a method for replacing MVA content with AVA content. [Figure 3b] FIG. 3b is a flowchart of a method for replacing MVA content with AVA content. [Figure 4] FIG. 4 is a diagram illustrating a decision center. [Figure 5a] FIG. 5a shows an example of an MVA content block descriptor and the selection of MVA content to be replaced. [Figure 5b] FIG. 5b shows an example of an MVA content block descriptor and selecting the MVA content to be replaced. DETAILED DESCRIPTION OF THE INVENTION

[0040] FIG. 1 illustrates one embodiment of a system according to the present invention, showing a smart receiver (001) connected to a traditional television broadcast network (002) and a broadband network (003) that provide access to the Internet. For purposes of the present invention, each of the networks (002-003) is considered a fully digital network. The smart receiver (001) can support the reproduction of traditional broadcast television content through its connection to a television broadcast network (002), such as a digital terrestrial TV network, a digital cable TV network, or a digital satellite TV network. In addition to traditional television set functionality, the smart receiver (001) can also support the delivery of on-demand online content, such as streaming services, over-the-top (OTT) content, or video-on-demand (VOD), through its connection to an over-the-top application (OTT application) (004).

[0041] The broadband network (003) is a standard Internet Protocol (IP) based network, such as a private IP network owned by a telecommunications carrier, cable operator, or publicly available broadband provider.

[0042] Thus, the smart receiver (001) supports a model in which linearly (or live) broadcasted TV content (hereinafter referred to as MVA content (005)) is consumed via a digital broadcast connection (002) complemented by a digital broadband Internet connection (003). The digital broadcast connection can be, for example, a transmission based on the ISDB-T-based transmission standard used in the Brazilian digital TV system, or a transmission based on another type of digital TV standard, for example, DVB-T, ATSC, provided by a broadcast network based on terrestrial, cable or satellite access.

[0043] The digital broadband connection (003) allows the smart receiver (001) to access alternative audiovisual content (AVA) (006) that can be downloaded or broadcast to the smart receiver (001).

[0044] The smart receiver (001) can be an IBB digital TV receiver that supports the integration of broadcast transmission (002) and broadband distribution (003) to the end consumer. The IBB smart receiver can operate with various digital transmission technologies, such as terrestrial, cable, or satellite transmission.

[0045] Figure 2 shows the content substitution and insertion module (011) of the smart receiver (001) responsible for consuming MVA content (005) broadcast by broadcast transmission (002) and AVA content (006) broadcast over a broadband network (003). This module performs the replacement of MVA content (005) with AVA content (006) through analysis of data (content descriptors (007) and synchronization events (008)) sent by the broadcaster (009).

[0046] Figures 3a and 3b show the method used by the Content Replacement and Insertion Module (011) to perform the replacement of MVA content (005) with AVA content (006) to ensure the best possible experience for the viewer.

[0047] As can be seen, the system according to the present invention interprets requests / signals from the broadcaster (009) using techniques such as, but not limited to, so-called "system events." This signaling is interpreted by the system as a request to replace the MVA content (005) with AVA content (006), informing the digital TV receiver of the structure and nature of the MVA content (005).

[0048] According to the implementation method of the system of the present invention in the TV receiver, in a first step (021), the digital TV receiver receives an MVA content descriptor (007) from the broadcaster (009), as shown in Figures 5a and 5b, which will be indicated at some time in the future. Next, a decision-making center (012) analyzes the MVA content descriptor (007) and uses specific markings / tags in the descriptor for a particular piece of content to detect whether that particular piece of content can be replaced by AVA content (006). The decision-making center (012) is responsible for assessing whether the digital TV receiver has sufficient conditions to replace the MVA content (005) with the AVA content (006) without adversely affecting the viewer's experience.

[0049] In the next step (022), the decision center (012) then evaluates whether an OTT-type application ("over-the-top") (004) associated with the tuned channel is installed on the digital TV receiver and whether the consumer / viewer is specifically identified (013). In this way, the digital TV receiver can select and request the display of an AVA (006) at the correct time and according to the broadcaster's criteria (009) for that viewer / consumer. The OTT application (004) is also responsible for interacting with the AVA content provider (010) and obtaining from this source the AVA content (005) to be played by the system. Access to the AVA content provider (010) is, for example, via an HTTP connection over the Internet accessed via the broadband network (003).

[0050] In the next step (023), the decision-making center (012) attempts to determine whether the replacement of the MVA content (005) with the AVA content (006) can be performed without degrading the viewer's experience. To this end, the decision-making center (012) collects relevant parameters from the digital TV receiver by means of a data collection module (039) to determine (a) whether the AVA content (006) can be played in its entirety without interruption, and (b) whether the replacement of the MVA content (005) with the AVA content (006) can be performed within an acceptable time without degrading the viewer's experience.

[0051] Examples of relevant parameters include, but are not limited to: -Internet connection speed (003), -Internet connection delay (003), -Internet connection packet loss rate (0.03), -CPU usage (040), -System memory usage (041), -Video memory usage (042), - the average time to replace MVA content (005) with AVA content (006) at this receiver, - the cumulative number of failures to replace MVA content (005) with AVA content (006) on this receiver, -Playback restrictions for AVA content (005).

[0052] According to the present invention, all relevant receiver parameters are provided and the Data Collection Module (039) attempts to estimate the time required to exchange MVA content (005) with AVA content (006) (called Content Exchange Time (CET) (044)), the maximum quality (Qmax) (045), and the maximum duration (Dmax) (046) that the AVA content (006) can be played without interruption.

[0053] The data collection module (039) then checks whether the device is registered in a specially identified receiver database (043). If the device is registered, the replacement process ends, since the MVA content (005) cannot be replaced with the AVA content (006). The purpose of this database (043) is to register all devices that have failed to replace the MVA content (005) with the AVA content (006). This database (043) can be implemented locally on the receiver (001) or remotely at a broadcaster (009) center. The broadcaster (009) is free to decide when to register or remove devices from this database (043).

[0054] When executed, in step (024), the decision-making center (012) analyzes the MVA content descriptor (007) to search for MVA content (005) that is compatible with the CET, Qmax and Dmax estimated by the data collection module (039).

[0055] Figures 5a and 5b show possible MVA content descriptors (007) and their compatibility with the CET (057), Qmax (058), and Dmax (059) parameters. It can be observed that in the current descriptor, MVA content (047) cannot be replaced because its duration (051) is longer than Dmax (059), and content (048) is incompatible because its start time (054) is shorter than the estimated CET (057). The only content eligible for replacement is content (049), which has a duration (055) less than Dmax (059) and a sufficient transition time (056) longer than the CET (057) to allow the transition to occur without losing content.

[0056] Next, in step (025), the decision-making center (012) informs the OTT application (004) of the nature of the MVA content (005) to be replaced and the estimated maximum quality Qmax (058) of the AVA content (006). The OTT application (004) then sends this information, along with the viewer's identification, to the AVA content provider (010). The provider is expected to select AVA content (006) that is compatible with the MVA content (005) selected for replacement according to the technologies and products commonly used in the market for segmenting VoD (Video on Demand) content. It is important that the content meets the requirements for maximum quality and maximum duration defined by the system to provide the viewer with the best possible experience.

[0057] In the next step (026), the decision center (012) provides resources for the playback of the AVA (006) by checking whether the playback conditions are met. For example, typical conditions include CPU utilization (040), amount of available system memory (041), amount of available storage (050), bandwidth speed and latency (003), etc. The decision center (012) requests (037) the OTT application (004) to load the AVA content (006) into the streaming module (014) using well-known techniques for playing remote content.

[0058] However, the fundamental difference is that the streaming module (014) must perform all steps necessary to play the AVA content (006) (with the exception of the final step of inserting the content into the decoder (015)). We refer to this process as AVA content preloading (006).

[0059] In the next step (027), if all conditions for playback are met and the AVA content (006) has been properly preloaded, the decision center sends a start command (038) to the synchronizer (016) which monitors synchronization events (008) to ensure perfect synchronization in the transition between the playback of MVA (005) -> AVA (006) -> MVA (005).

[0060] The synchronization events (008) allow the broadcaster (009) to control the exact time to start the AVA content (006), the exact time to end the AVA content (006), and whether to end the content AVA (006) early.

[0061] The final condition is to ensure that the playback state of MVA(005) is reverted to without unnecessary failures, and to maintain accurate timing for resuming presentation so that the viewer does not lose any content in MVA(005) or AVA(006).

[0062] In some cases, the broadcaster (009) may decide to end the playback of the AVA content (006) early, such as in the case of an urgent live event that must be shown to the audience in person.

[0063] In the next step (028), the synchronizer (016) detects the exact moment of the start of the AVA content (006) by monitoring the synchronization event (008). It is important that this control is exercised by the broadcaster (009). Those skilled in the art will know that it is nearly impossible to plan broadcast transmissions (002) far in advance, for example, due to the occurrence of special programs such as live sporting events, where it is impossible to know exactly when the MVA content (005) will start or end. Therefore, unlike the MVA content descriptor (007), which must be sent as early as possible to allow preloading, the start time of the AVA content (006) must be communicated to the digital TV receiver as close as possible to the moment the AVA content (006) begins. The difference in the timing requirements of these two signals means that the synchronization event (008) is the basis for guaranteeing the start time of the AVA content (006) playback with the greatest accuracy. Therefore, it is important that the synchronization event (008) allows the system (011) of the present invention to balance these different requirements by performing all verification and preloading processes of the AVA content (006) as early as possible, while starting the playback of the AVA content (006) as accurately as possible.

[0064] Thus, once the start time of the AVA content (006) is detected, in step (029), the synchronizer sends an insertion command (019) for the AVA content (006) to the streaming module (014) and a content switch command (020) to the content selector (017). The content selector (017) switches the source of the audio and video content to be inserted into the decoder (015), which previously received this content directly from the tuner (018) and now typically begins receiving this content from the AVA content server (010), for example, via an HTTP connection over the Internet (003) using a broadband network.

[0065] In the next step (030), while the AVA content (006) is being played, the synchronizer (016) monitors synchronization events (008) sent by the broadcaster to determine the end time of the AVA content, which may represent a natural end of the AVA content (006) or a voluntary and abrupt end of the AVA content (006) by the broadcaster (009).

[0066] In step (031), the system naturally detects the end of the AVA content (006) by the end of the AVA content (006) or by an end signal in this step (031). In step (032), the content selector (017) immediately replaces the AVA content (006) with MVA content (005) from the digital TV signal broadcasting network (002).

[0067] Finally, after displaying the AVA (006), the OTT application (004) may collect information related to the TV broadcaster (009), such as, but not limited to, user identification for statistical purposes, date, time, IP address, bandwidth, latency, TV receiver make / model, AVA display status, etc.

[0068] In any situation (033), the decision-making center (012) mitigates factors critical to synchronization by checking the condition of the digital TV receiver at various times by periodically evaluating various parameters such as CPU usage, amount of available general-purpose memory (RAM), amount of storage memory for temporary use, speed and latency of the Internet connection, characteristics of the AVA content (006) being played, and the user's identification status (identified / unidentified). In case of failure (034), in step (035), the decision-making center (012) notifies the broadcaster center (060) of the parameters collected from the digital TV receiver at the time of failure, the characteristics of the AVA content (006), and the viewer's identification (013) by sending failure data (061). In step (036), the broadcaster center (060) decides whether this receiver should be characterized as having positive restrictions on the playback of AVA (006) from this point on, and determines whether this receiver should be characterized as having positive restrictions on the playback of AVA content (006). (005) It is registered in the receiver database (043) as being restricted to replacement.

[0069] A failure to play AVA content (006) may be characterized by, but is not limited to, an interruption in the playback of AVA content (006), a failure to synchronize the audio and video of the AVA content (006), spontaneous termination of playback of the AVA content (006), and an inability to access the AVA content provider (010).

[0070] A failure to replace MVA content (005) with AVA content (006) can be characterized, for example, as a delay in switching MVA content (005) to AVA content (006) and vice versa, and a duration incompatibility between MVA content (005) and AVA content (006).

[0071] [Example of embodiment] 1, 2 and 3 above show non-limiting schematic examples within the scope of the present invention, illustrating some of the possible ways in which the system according to the present invention can be operated with a digital TV receiver where a broadcaster wishes to create a customized video / audio playback experience for a given group of consumers or for a single consumer.

Claims

1. 1. A system for ingesting alternative video and / or audio media content synchronized with presentation of linear original video and audio content and replacing portions of the linear original video and audio content with the alternative video and audio media content, the system comprising: - a smart digital TV receiver (001) connected to a conventional television broadcast network (002) and a broadband network (003) capable of accessing the Internet, the smart digital TV receiver (001) supporting playback of conventional broadcast television content through its connection with the television broadcast network (002) and also supporting delivery of on-demand online content such as streaming services, over-the-top (OTT) content or video-on-demand (VOD) through its connection with the broadband network (003); an over-the-top application (OTT application) (004) configured to receive alternative video and audio (AVA) content by connecting to a broadband network (003); a content replacement and insertion module (011) adapted to receive, by connection with a television broadcast network (002), all main video and / or audio content MVA (005) broadcast linearly (or live), said AVA content being used to replace said MVA content, said AVA content being equivalent to the MVA content it replaces; The content replacement and insertion module (011) comprises: i. A digital TV receiver tuner (018) for receiving MVA content from a connection with a television broadcast network (002); ii. A decision-making center (012), determining to replace the MVA content (005) with the AVA content (006) based on periodic evaluation (033) of the smart digital TV receiver's relevant environmental parameters for the playback of the AVA content by collecting relevant parameters from the smart digital TV receiver's environment via a data collection module (039), the relevant parameters being used by the decision-making center to determine whether the smart digital TV receiver can play the AVA content (006) in its entirety without interruption, and whether the smart digital TV receiver can replace the MVA content (005) with the AVA content (006) in a manner that a viewer does not observe an interruption in the playback of the AVA content and does not observe a degradation / change in the quality of the AVA content; Evaluating whether an OTT ("Over-the-Top") application (004) associated with the tuned channel is installed on said smart digital TV receiver and whether the consumer / viewer has been specially identified (013); via said data collection module (039), based on said relevant parameters, estimating the content exchange time (CET) (049) required to replace said MVA content (005) with said AVA content (006), the maximum quality (Qmax) (045), and the maximum duration (Dmax) (046) of said AVA content (006) that can be played without interruption or quality degradation / change of the AVA content; receiving and analyzing the MVA content descriptor (007), searching for MVA content (005) compatible with the CET (057), Qmax (058), and Dmax (059) estimated by the data collection module (039), and determining that the searched MVA content will be replaced with the AVA content; verifying, via the data collection module (039), whether the smart digital TV receiver (001) is registered in a specially identified receiver database (043), wherein the registered receiver is characterized as having a positive restriction on the playback of the AVA content (006) based on previous failure data and is positively restricted from performing the substitution of the MVA content (005), and the smart digital TV receiver is registered in the receiver database based on a failure that occurred when the corresponding smart digital TV receiver played the AVA content; If it is determined that the smart digital TV receiver (001) is registered in the receiver database (043), the smart digital TV receiver is prevented from using the AVA content to replace the MVA content. The decision-making center (012) is responsible for iii. A synchronizer (016) configured to monitor synchronization events sent by a broadcaster and detect the exact moment of the start of AVA content (006), wherein, when the start time of the AVA content (006) is detected, the synchronizer (016) sends an insert command (019) for the AVA content (006) to the streaming module (014) and instructs the content selector (017) to switch to the AVA content (006); iv. a streaming module (014) configured to receive AVA content from an OTT application (004) and insert said AVA content into a content selector (017); v. a content selector (017) that receives a command switch command (020) and performs a replacement of the MVA content (005) with the AVA content (006) by switching to a source of audio and video content to be inserted into a decoder (015), the decoder (015) having previously received audio and video content directly from a tuner (018) and now beginning to receive audio and video content from an AVA content server (010); vi. a decoder (015) that previously received audio and video content directly from the tuner, and into which the AVA content is inserted when the source of the audio and video content is switched to an AVA content server by the content selector (017); A system comprising:

2. The system described in claim 1, characterized in that the smart digital TV receiver (001) may be an IBB digital TV receiver that supports integration of broadcast transmission (002) and broadband distribution (003) to the end consumer.

3. The system described in claim 2, characterized in that the IBB digital TV receiver is configured to operate with various digital terrestrial, cable or satellite broadcasting technologies.

4. The system described in claim 1, characterized in that the broadband network (003) is a private Internet Protocol (IP) based network owned by a telecommunications operator or cable operator or a publicly available broadband provider.

5. 2. The system of claim 1, wherein the smart digital TV receiver (001) uses a digital broadband connection (003) to access alternative audiovisual content (AVA) (006) that can be downloaded or broadcast to the smart digital TV receiver (001).

6. The system described in claim 1, characterized in that the digital broadcasting connection is an ISDB-T based transmission standard used in the Brazilian digital TV system provided by broadcasting networks based on terrestrial, cable or satellite access.

7. The system described in claim 1, characterized in that the digital broadcasting connection is a transmission based on the digital TV standard DVB-T, ATSC, etc. provided by a broadcasting network based on terrestrial, cable or satellite access.

8. A method for implementing a system capable of ingesting alternative video and / or audio media (AVA) synchronized with the presentation of linear video and audio content from a broadcaster and replacing a portion of the original main video and audio (MVA) content, said method being based on periodic evaluation of parameters in a smart digital TV receiver's environment that reflect the capacity and performance conditions of said smart digital TV receiver and its connection to the Internet as they change over time, said parameters being relevant to playing back the entire AVA content without interruption or degradation in quality, said method essentially comprising: - interpreting requests / signals from the broadcaster (009); - informing the smart digital TV receiver of the structure and nature of the main video and / or audio (MVA) content (005); - receiving by a smart digital TV receiver the MVA content descriptors (007) sent by said broadcaster (009) for content to be displayed at any time in the future; - analyzing said MVA content descriptors (007) by a decision-making center (012) to detect whether a particular MVA content can be replaced by an alternative video and audio media (AVA) content (006) through a specific marking in the descriptor of that particular content, said AVA content being equivalent to the MVA content to be replaced; - said decision-making center carries out an evaluation (033) of the relevant parameters of said smart digital TV receiver for the reproduction of said AVA content, thereby assessing whether said smart digital TV receiver has sufficient conditions to reproduce said AVA content (006) in its entirety without interruption and to replace said MVA content (005) with said AVA content (006) in such a way that the viewer does not observe any interruption in the reproduction of said AVA content and does not observe any degradation / change in the quality of said AVA content; - evaluating by the decision-making center (012) whether an OTT ("Over-the-Top") application (004) associated with the tuned channel is installed on the smart digital TV receiver and whether the consumer / viewer has been specially identified (013); - Selecting and requesting by the smart digital TV receiver to display the AVA content (006) at the correct time according to the broadcaster's standards (009) for that viewer / consumer; - estimating, via a data collection module (039), based on said relevant parameters, the content exchange time (CET) required to replace said MVA content (005) with said AVA content (006), the maximum quality (Qmax) (045) and the maximum duration (Dmax) (046) of said AVA content (006) that can be played without interruption or quality degradation / change of said AVA content (006); - verifying by a data collection module (039) whether a device is registered in a specially identified receiver database (043) restricted to replacing MVA content (005), wherein the registered smart digital TV receiver is characterized as having a positive restriction on the playback of the AVA content based on previous failure data, and is therefore positively restricted from performing the replacement of the MVA content, and the smart digital TV receiver is registered in the receiver database based on a failure that occurred when the corresponding smart digital TV receiver played the AVA content; - upon determining that the smart digital TV receiver is registered in the receiver database, preventing the smart digital TV receiver from using the AVA content to replace the MVA content; - analyzing, by a decision-making center (012), the MVA content descriptors (007) to search for MVA content (005) compatible with the CET (057), Qmax (058) and Dmax (059) estimated by the data collection module (039), and deciding that said searched MVA content will be replaced by said AVA content; - providing, during the preload request (037), information to the OTT application (004) by the decision-making center (012) about the nature of the MVA content (005) to be replaced and about the estimated maximum quality Qmax (058) and maximum duration (059) of the AVA content (006), ensuring that said AVA content meets the Qmax and Dmax requirements without degradation / change in the quality of said AVA content; - providing resources for the reproduction of the AVA (006) by the decision-making center (012) and verifying that the conditions for its reproduction are met; - requesting the OTT application (004) by the decision-making center (012) to load the AVA content (006) into the streaming module (014); - sending a start command (038) by the decision-making center (012) to the synchronizer (016); - detecting, by a synchronizer (016), the exact moment to start playing said AVA content (006) by monitoring synchronization events (008) sent by the broadcaster; - sending, by the synchronizer (016), an insert command to insert AVA content to the streaming module and a content switch command to the content selector (017); - switching the source of the audio and video content inserted into the decoder of the smart digital TV receiver by said content selector (017), effectively transitioning from said MVA content (005) to said AVA content (006); - monitoring by a synchronizer (016) the synchronization events (008) sent by the broadcaster (009) to ensure synchronization in the transition from MVA content to AVA content and back to the playback of MVA content; - determining the end time of the AVA content by the synchronizer (016), either by the natural end of the playback of the AVA content or by receiving an early end signal in a monitored synchronization event (008); - instantly switching the source of the audio and video content to the digital TV signal broadcasting network by the content selector (017), effectively transitioning from AVA content to MVA content; - if the decision-making center (012) determines that sufficient conditions for the reproduction of the AVA content are not met, it notifies the broadcaster by sending information such as failure data (061), parameters collected from the environment of the smart digital TV receiver at the time of the failure, the characteristics of the AVA content (006) and the consumer / viewer's identification (013); - collecting information related to the TV broadcaster (009) by the OTT application (004) for statistical purposes, such as, but not limited to, user identification, date, time, IP address, bandwidth, delay time, make / model of smart digital TV receiver, and AVA display status.

9. 9. The method of claim 8, further comprising interacting with an AVA content provider (010) of the OTT application (004) to obtain proprietary AVA content (005) from the source for playback by the system.

10. The data collection module (039) performs the following steps: a) verifying whether the smart digital TV receiver is registered in the database (043) and is characterized by having an active restriction on the playback of AVA content (006) and is therefore restricted from performing substitutions of MVA content (005); b) collecting relevant environmental parameters for said decision-making center (012) from smart digital TV receivers, said relevant environmental parameters comprising: - Internet connection speed (003), - Internet connection delay (003), - Internet connection packet loss rate (0.03), -CPU usage rate (040), - System memory usage (041), - Video memory usage (042), - the average time to replace MVA content (005) with AVA content (006) on this smart digital TV receiver; - the cumulative number of failures in replacing MVA content (005) with AVA content (006) on this smart digital TV receiver; - Playback restrictions for AVA content (005), a step, including associated parameters; c) estimating the time required to exchange the MVA content (005) with the AVA content (006), called the Content Exchange Time (CET) (044), the maximum quality (Qmax) (045), and the maximum duration (Dmax) (046) that the AVA content (006) can play without interruption; d) collecting the relevant parameters and data estimated in the previous steps for the decision-making center (012); 9. The packaging method of claim 8, further comprising:

11. The decision-making center (012) performs the following steps: a) determining whether the AVA content (006) can be played in its entirety without interruption or quality degradation / change of the AVA content (005); b) determining whether the replacement of MVA content with AVA content can be performed within an acceptable timeframe without adversely affecting the consumer / viewer experience by performing periodic evaluations of parameters in the smart digital TV receiver's environment that reflect the capacity and performance requirements of the smart digital TV receiver and its connection to the Internet as they change over time, said parameters being relevant to playing the entire AVA content without interruption or degradation of the AVA content; The method of claim 8 further comprising:

12. An implementation method as described in claim 8, wherein the information related to the broadcaster collected by the OTT application includes user identification, date, time, Internet Protocol (IP) address, bandwidth, latency, make / model of smart digital TV receiver, AVA display status, or a combination thereof.

13. The data collection module (039) I. verifying whether the smart digital TV receiver (001) is registered in a specially identified receiver database (043), and said registered receiver is characterized as having a positive restriction on said playback of said AVA content (006) based on previous failure data, and is positively restricted from performing said substitution of said MVA content (005); II. From a smart digital TV receiver and its broadband connection, - Internet connection speed (003), - Internet connection delay (003), - Internet connection packet loss rate (0.03), -CPU usage rate (040), - System memory usage (041), - Video memory usage (042), - the average time to replace MVA content (005) with AVA content (006) on this smart digital TV receiver (001); - the cumulative number of failures in replacing MVA content (005) with AVA content (006) on this smart digital TV receiver (001); - Playback restrictions for AVA content (006), Collect relevant environmental parameters, including III. Estimate the time required to exchange MVA content with AVA content, called Content Exchange Time (CET) (049), the maximum quality (Qmax) (045), and the maximum duration (Dmax) (046) of AVA content (006) that the AVA content can play without interruption or quality degradation / change of the AVA content; IV. Collecting estimated relevant parameters and data for the decision-making center (012); 2. The system of claim 1.

14. - The system of claim 1, wherein if the decision-making center (012) determines that sufficient conditions for the playback of the AVA content (006) are not met, the decision-making center is further configured to notify the broadcaster (009) by sending information such as failure data (061), environmental parameters (033) collected from the smart digital TV receiver at the time of the failure, characteristics of the AVA content, and consumer / viewer identification, and the broadcaster determines from this point on whether the smart digital TV receiver should be characterized as having an active restriction on the playback of AVA content and registers the smart digital TV receiver in its smart digital TV receiver database as being actively restricted from performing the substitution of the MVA content.

Images