Determining when a trigger should be generated

Abstract

An apparatus, method, system and computer-readable medium are disclosed for, in one aspect, determining when a trigger, such as an application trigger, should be generated. In some embodiments, the application trigger may be generated when a frame included in a feed ( e.g., a content feed) matches a specified or indicated frame. In some embodiments, a comparison between the feed and the specified or indicated frame may be based on one or more tolerances or thresholds. In some embodiments, the feed may be split and content (e.g., video) obtained via the split may be combined (e.g., multiplexed) with a trigger. The combined content and trigger may be transmitted to one or more devices, such as one or more user devices.

Description

DETERMINING WHEN A TRIGGER SHOULD BE GENERA TED This application is a divisional of Canadian Patent Application No. 2,787,562 filed on August 23, 2012. BACKGROUND Advancements in technology have changed the way users consume and interact with content and other users. For example, a user might not want to be restricted to a passive viewing experience, and may want to interact with content or other users. Interactive television and applications are examples allowing users to interact with one another and with content. Traditional techniques for providing or running applications or interactive content may be prone to error, and improvements are needed. SUMMARY This summary is not intended to identify critical or essential features of the disclosure provided herein, but instead merely summarizes certain features and variations thereof. In some illustrative embodiments, an application author or provider may specify one or more frames of a content item that is to be associated with an application trigger. Frames associated with the content item may be monitored to determine whether a frame associated with an application trigger is being transmitted to a user device. If a frame associated with an application trigger is being transmitted to a user device, the application trigger may be transmitted to and / or executed at the user device. In some embodiments, a device ( e.g., a streamer device) may decode and monitor frames received with a feed (e.g., a video feed). The streamer may use a comparison algorithm (e.g., an image comparison algorithm) to determine if a current frame matches a frame corresponding to a trigger. If there is a match, a trigger may be transmitted. In some embodiments, the determination of whether a match exists may be based on one or more thresholds or tolerances. I Date Re9ue / Date Received 2021-06-14 In some embodiments, an event associated with a trigger may execute until a condition occurs. The condition may comprise a receipt of a "cancel" frame. The condition may comprise an expiration of the trigger for the content. In some embodiments, frame-based trigger techniques may be used in combination with time-based trigger techniques or other techniques. Other details and features will also be described in the sections that follow. BRIEF DESCRIPTION OF THE DRAWINGS Some features herein are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements. Figure 1 illustrates an example distribution network. Figure 2 illustrates an example platform on which the various elements described herein can be implemented. Figure 3 illustrates an environment suitable for demonstrating one or more aspects of this disclosure. Figure 4 illustrates a method suitable for demonstrating one or more aspects of this disclosure. DETAILED DESCRIPTION Various connections between elements are discussed in the following description. These connections are general and, unless specified otherwise, may be for example direct or indirect, wired or wireless, and this specification is not intended to be limiting in this respect. In the following description of various illustrative embodiments, reference is made to the accompanying drawings, which form a part hereof, and in which is shown, by way of illustration, various embodiments in which aspects of the disclosure may be practiced. It is to be understood that other embodiments may be utilized and structural and functional modifications may be made, without departing from the scope of the present disclosure. Figure 1 illustrates an example information (e.g., content) distribution network 100 on which many of the various features described herein may be implemented. Network 100 may 2 Date Re9ue / Date Received 2021-06-14 be any type of information distribution network, such as satellite, telephone, cellular, wireless, etc. One example may be an optical fiber network, a coaxial cable network or a hybrid fiber / coax distribution network. Such networks 100 use a series of interconnected communication lines 101 (e.g., coaxial cables, optical fibers, wireless, etc.) to connect multiple premises 102 (e.g., businesses, homes, consumer dwellings, etc.) to a central office or headend 103. The central office 103 may transmit downstream information signals onto the lines 101, and each premises 102 may have a receiver used to receive and process those signals. There may be one line 101 originating from the central office 103, and it may be split a number of times to distribute the signal to various premises 102 in the vicinity (which may be many miles) of the central office 103. The lines 101 may include components not illustrated, such as splitters, filters, amplifiers, etc. to help convey the signal clearly, but in general each split introduces a bit of signal degradation. Portions of the lines 101 may also be implemented with fiber-optic cable, while other portions may be implemented with coaxial cable, other lines, or wireless communication paths. The central office 103 may include a termination system (TS) 104, such as a cable modem termination system (CMTS) in some types of networks, which may be a computing device configured to manage communications between devices on the network of lines 101 and backend devices such as servers 105-107 (to be discussed further below). The termination system (TS) may be as specified in a standard, such as the Data Over Cable Service Interface Specification (DOCSIS) standard, published by Cable Television Laboratories, Inc. (a.k.a. CableLabs), or it may be a similar or modified device instead. The termination system (TS) may be configured to place data on one or more downstream communications lines and / or frequencies to be received by modems at the various premises 102, and to receive upstream communications from those modems on one or more upstream frequencies. The central office 103 may also include one or more network interfaces 108, which can permit the central office 103 to communicate with various other external networks 109. These networks 109 may include, for example, networks of Internet devices, telephone networks, cellular telephone networks, fiber optic networks, local wireless networks (e.g., WiMAX), satellite networks, and any other desired network, and the interface 108 may 3 Date Re9ue / Date Received 2021-06-14 include the corresponding circuitry needed to communicate on the network 109, and to other devices on the network such as a cellular telephone network and its corresponding cell phones. As noted above, the central office 103 may include or have access to a variety of servers 105-107 that may be configured to perform various functions. For example, the central office 103 may include a push notification server 105. The push notification server 105 may generate push notifications to deliver data and / or commands to the various premises 102 in the network ( or more specifically, to the devices in the premises 102 that are configured to detect such notifications). The central office 103 may also include a content server 106. The content server 106 may be one or more computing devices that are configured to provide content to users in the homes. This content may be, for example, video on demand movies, television programs, songs, text listings, etc. The content server 106 may include software to validate user identities and entitlements, locate and retrieve requested content, encrypt the content, and initiate delivery (e.g., streaming) of the content to the requesting user and / or device. The central office 103 may also include one or more application servers 107. An application server 107 may be a computing device configured to offer any desired service, and may run various languages and operating systems (e.g., servlets and JSP pages running on TOMCAT / MYSQL, OSX, BSD, UBUNTU, RED HAT, HTML5, JAVASCRIPT, AJAX and COMET). For example, an application server may be responsible for collecting television program listings information and generating a data download for electronic program guide or interactive program guide listings. Another application server may be responsible for monitoring user viewing habits and collecting that information for use in selecting advertisements. Another application server may be responsible for formatting and inserting advertisements in a video stream being transmitted to the premises 102. Another application server may be responsible for receiving user remote control commands, and processing them to provide an intelligent remote control experience. An example premises 102a may include an interface device 122. In one aspect, the interface device 122 may comprise a modem 110, which may include transmitters and receivers used to communicate on the lines 101 and with the central office 103. The modem 4 Date Re9ue / Date Received 2021-06-14 110 may be, for example, a coaxial cable modem (for coaxial cable lines 101), a fiber interface node (for fiber optic lines 101), or any other desired modem device. The interface device 122 may also be connected to, or be a part of, a gateway interface device 111. The gateway interface device 111 may be a computing device that communicates with the modem 110 to allow one or more other devices in the premises 102a to communicate with the central office 103 and other devices beyond the central office. The gateway 111 may be a set-top box (STB), digital video recorder (DVR), computer server, or any other desired computing device. The gateway 111 may also include (not shown) local network interfaces to provide communication signals to devices in the premises 102a, such as televisions 112, additional STBs 113, personal computers 114, laptop computers 115, wireless devices 116 (wireless laptops and netbooks, mobile phones, mobile televisions, personal digital assistants (PDA), etc.), and any other desired devices. Examples of the local network interfaces include Multimedia Over Coax Alliance (MoCA) interfaces, Ethernet interfaces, universal serial bus (USB) interfaces, wireless interfaces (e.g., IEEE 802.11), BLUETOOTH interfaces, and others. Figure 2 illustrates general hardware elements that can be used to implement any of the various computing devices discussed above. The computing device 200 may include one or more processors 201, which may execute instructions of a computer program to perform any of the features described herein. The instructions may be stored in any type of computerreadable medium or memory, to configure the operation of the processor 201. For example, instructions may be stored in one or more of a read-only memory (ROM) 202, random access memory (RAM) 203, removable media 204, such as a Universal Serial Bus (USB) drive, compact disk (CD) or digital versatile disk (DVD), floppy disk drive, or any other desired electronic storage medium. Instructions may also be stored in an attached ( or internal) hard drive 205. The computing device 200 may include one or more output devices, such as a display 206 (or an external television), and may include one or more output device controllers 207, such as a video processor. There may also be one or more user input devices 208, such as a remote control, keyboard, mouse, touch screen, microphone, etc. The computing device 200 may also include one or more network interfaces, such as input / output circuits 209 (such as a network card) to communicate with an external network 210. The network interface may 5 Date Re9ue / Date Received 2021-06-14 be a wired interface, wireless interface, or a combination of the two. In some embodiments, the interface 209 may include a modem (e.g., a cable modem), and network 210 may include the communication lines 101 discussed above, the external network 109, an in-home network, a provider's wireless, coaxial, fiber, or hybrid fiber / coaxial distribution system (e.g., a DOCSIS network), or any other desired network. This disclosure identifies and addresses an issue associated with absolute-time-based triggers. For example, if a trigger that causes an application to provide an output or stimulus (e.g., an interactive poll) to a user is specified as being transmitted or executed at an absolute time (e.g., 10:28AM on Sunday) based on a scheduled transmission of content, and then a scheduling change causes the content to be transmitted at a time different from what was initially specified, an event associated with the trigger may execute at an unintended time. In other words, due to a change in the scheduled transmission of the content, the trigger might not be synchronized to the underlying content. To address the above-noted problem / issue related to absolute-time-based triggers, relative triggering may be used. In relative triggering, an application author / provider may specify that a trigger is to be transmitted or executed at a time that is offset relative to a reference time associated with the content (e.g., the start or end of the content). In this manner, even if the transmission of the content changes relative to an initial schedule, the trigger may be synchronized with the content. Relative triggering might be counter-intuitive from an application author or provider's perspective. For example, an application author or provider may have to engage in a time-consuming trial-and-error process to determine the appropriate location or spot in the content to which the trigger should be associated. Aspects of this disclosure may address problems / issues associated with relative triggering. Aspects of this disclosure may be implemented to synchronize one or more application triggers to one or more content items (e.g., television programs, advertisements, movies, computer programs, text files, audio files (i.e., music), etc.). An application authoring process may be streamlined and more intuitive using one or more of the techniques described herein. Figure 3 illustrates an environment suitable for demonstrating one or more aspects of this disclosure. In some embodiments, the devices and methods shown and described in 6 Date Re9ue / Date Received 2021-06-14 connection with Figure 3 may be implemented using one or more of the components and devices described above in connection with Figures 1-2. As shown in Figure 3, a device such as a splitter 302 may receive a feed, such as a content feed from one or more sources. In some embodiments, the feed may be generated by, for example, a broadcast source or a narrowcast source (e.g., a multicast source or a unicast source). For purposes of illustrative simplicity, the feed is discussed below as pertaining to video. Alternatively, or additionally, other types of content or data may be used or included in some embodiments. Splitter 302 may generate or output video, which may be provided to a streamer server 308 and a multiplexer 314. Also shown in Figure 3 is an application server 320. Server 320, or another computing device, may receive an input that may specify or identify one or more frames, or an identification of a point in time within a piece of content, to be associated with a trigger for a particular application or group of applications, for example. The input may be generated by, or received from, a user, a network operator, a content creator, an independent developer, etc. The specified or identified frame(s) may, for example, coincide with one or more frames of video output by splitter 302. Server 320 may access or generate an application, such as an enhanced television (ETV) application, and output the application. The application output by server 320 may include one or more triggers. In some embodiments, a trigger may be embedded in an application. For example, multiplexing may be used to embed a trigger in an application. In some embodiments, a trigger may be sent or transmitted separate from an application. The application output by server 320 may also include video frame information. The application may adhere to one or more standards, specifications, or protocols, such as TRU2W AY / OCAP, Enhanced TV Binary Interchange Format (EBIF), ETV Integrated Signaling Stream (EISS), etc. Streamer server 308, or another computing device, may monitor video from splitter 302 for one or more frames that may correspond to one or more frames that may be specified via the input to server 320 (and included in the application output by server 320). In some embodiments, streamer server 308 may include comparison logic, circuits, or software to facilitate a comparison between one or more frames included in the video and the specified one or more frames included in the application. In some embodiments, the frame comparison 7 Date Re9ue / Date Received 2021-06-14 may take place on a pixel-by-pixel basis. In some embodiments, color comparison techniques may be used. In some embodiments, macro block level techniques may be used. For example, in some embodiments, MPEG video streams may be encoded using macro blocks. If a certain ( e.g., a predetermined) number of macro blocks correspond or "agree," it may be concluded that a test frame matches a reference frame. In some embodiments, "facial recognition" techniques may be used. In some embodiments, hashing / "fuzzy" recognition algorithms, such as eigenvectors, may be used. In some embodiments, open source techniques (such as those used in a comparison of audio) may be used. In some embodiments, off-the-shelf components or circuits may be used to facilitate the frame comparison. In some embodiments, a comparison performed by streamer server 308 may be based at least in part on a predetermined tolerance or threshold to determine whether a match exists. For example, if a frame of video output by splitter 302 is within y¾ of a frame specified in the application output by server 320, then a match may be said to exist. In some embodiments, other criteria (e.g., other imaging criteria) may be used to determine whether a match exists. For example, in some embodiments, rather than determining whether a particular frame matches, a portion of a frame may be examined to determine whether a match exists. For example, if a logo or other graphic (e.g., a particular score associated with a particular football game) is included in a particular frame, that may suffice as a match. When a match is found to exist ( e.g., when one or more frames included in the video correspond to one or more frames specified in the application, optionally within one or more thresholds or tolerances), streamer server 308 may generate a trigger to signal that a client application 326 running at a user device 332, for example, should perform some function or activity. For example, a trigger may signal the client application 326 that user device 332 should display a menu, play a ring tone, transmit a message, launch a website ( e.g., a social networking website), launch an advertisement (e.g., a commercial), etc. As an example involving advertisements, a computing device (e.g., streamer server 308) may detect a frame with an actor drinking a particular brand of soda. In response to such a detection, an interactive advertisement related to the actor and / or the soda may be launched. In some embodiments, a trigger may be a "do-it-now" type of trigger, such that the client application 326 and / or user device 332 performs whatever task is associated with the 8 Date Re9ue / Date Received 2021-06-14 trigger upon receipt of the trigger. Alternatively, or additionally, the trigger may include a specification of an offset. The offset may be based on time or frames, for example. For example, the trigger may specify that the client application 326 and / or user device 332 should perform a task 'x' minutes after receipt of the trigger, where 'x' is a number. The offset may be based on an event. For example, the trigger may specify that the client application 326 and / or user device 332 should perform a task after receiving one or more user inputs at device 332. In some embodiments, a trigger may specify that the client application 326 should cease running or executing. For example, if a frame is received that indicates that a particular show or program is ending ( e.g., a frame corresponds to the credits that are displayed at the end of a television show or movie), a cancel-trigger may be generated to indicate that any applications related to that show or program should be terminated. In some embodiments, a cancel-trigger may be generated based on time, such as absolute time. For example, a canceltrigger based on time may be used to ensure that an application terminates at a specified time. In an illustrative scenario, a cancel-trigger based on time may be used to ensure that an application suitable for an adult audience terminates at 6AM when children are expected to first start waking up from a given night's sleep. In some embodiments, an action different from terminating an application may be taken in response to a cancel-trigger. For example, and referring to the above-described scenario related to children waking up at 6AM, an application may replace adult-themed displayed data with "child-friendly" displayed data starting at 6AM in response to receiving a cancel-trigger or another trigger. Various types of triggers may be used in some embodiments. Various triggers, or types of triggers, may be combined in some embodiments. For example, in some embodiments, "stacked" triggers may be used. The stacked triggers may be based on a particular combination or sequence of frames, occurring presently or in the future. For example, if frame 'X' is detected, application #1 may be launched, whereas if frame 'Y' is detected, application #2 may be launched. The stacked triggers may be configured to support any level or degree of complexity or specificity. As yet another illustrative example using stacked triggers, logic (e.g., at server 320 or 308) may specify that if frame 'Z' and frame 'A' 9 Date Re9ue / Date Received 2021-06-14 are detected, and frame 'B' is not detected, some action or task is to be performed. Alternatively, or additionally, the logic may specify that if frame 'Z' is present, capture the frame that is some specified amount of time before or after frame 'Z' - if that earlier or later frame is frame 'C', then perform some action or task. In some embodiments, a rules engine may be used to determine what action, task or event should be triggered in response to a detected frame or combination / sequence of frames. The rules engine may be in servers 320 or 308, or in another computing device. Streamer server 308 may generate or output enhanced video. Enhanced video may comprise video, applications, or triggers, or any combination thereof, in some embodiments. The enhanced video output by streamer server 308 may include triggers generated by the streamer server 308 as described above. The enhanced video output by streamer server 308 may include a "blue-screen" or "dummy video" as those terms are understood in the art. The blue-screen or dummy video may be used to facilitate trouble-shooting by a technician or other operator. The enhanced video output by streamer server 308 may include timing information. The timing information may be used to align or synchronize data (e.g., triggers) to video that is received at multiplexer 314. Multiplexer 314 or another computing device may combine the video received from splitter 302 with the enhanced video received from server 308 to generate output video. In some embodiments, the output video from multiplexer 314 may correspond to an enhanced MPEG stream. In some embodiments, multiplexer 314 may discard a blue-screen or dummy video that may be included in the enhanced video received from server 308 when performing the combination. In some embodiments, multiplexer 314 may transmit the output video to user device 332 or another point in a network. In some embodiments, multiplexer 314 may transmit the enhanced video (e.g., the triggers or application data) via in-band communications. For example, if an application is geared or directed to a particular channel or particular content (e.g., an application relates to a game show that is televised on a particular channel), then the use of in-band communications may ensure that the application cannot be accessed from other channels. In some embodiments, multiplexer 314 may transmit the enhanced video (e.g., the triggers or application data) via out-of-band communications. Out-of-band communications may be Date Re9ue / Date Received 2021-06-14 used, for example, when an application is intended to be available for use irrespective of a channel or content selection by a user - an example may relate to an electronic programming guide (EPG) or other general information, where data for an EPG application may be desirable irrespective of what program or channel a user has currently selected. The architecture described above is illustrative. In some embodiments, components and devices shown in Figure 3 might not be included. In some embodiments, additional components and devices not shown in Figure 3 may be included. For example, routers may be located between multiplexer 314 and user device 332 to facilitate the transmission of video and triggers from multiplexer 314 to user device 332. Also, while a single user device 332 is shown, in some embodiments any number of user devices may be included. In some embodiments, a number of user devices may be grouped into one or more service groups. In some embodiments, functionality described above with respect to each of the components or devices may be partially or completely reallocated to other devices in some embodiments. For example, a comparison that may be performed by streamer server 308 as described above may be performed at user device 332, and as such, triggers may be internally generated within user device 332 or another associated device. Such a (re)allocation of functionality may be suited to user devices with greater processing capabilities, such as next generation set-top boxes or gateways. In such embodiments, one or more reference frames may be transmitted to the user device 332. In some embodiments, a "hash" or "digest" of the one or more reference frames may be transmitted to the user device 332. Use of a "hash" or "digest" may help to preserve bandwidth (e.g., downstream transmission bandwidth). In some embodiments, streamer server 308 and multiplexer 314 may be combined into a single unit, casing, or housing. However, maintaining streamer server 308 and multiplexer 314 as separate or distinct entities may be beneficial. For example, multiplexer 314 may correspond to an off-the-shelf type of component that may have legacy properties or characteristics associated with it. In this regard, maintaining streamer server 308 and multiplexer 314 as separate or distinct entities may provide benefits in terms of lower costs by allowing a network or service provider to take advantage of economies of scale in terms of components or devices by leveraging existing infrastructure. 11 Date Re9ue / Date Received 2021-06-14 A network or service provider may prefer to maintain isolation or independence between the enhanced video or application data (shown as having been generated by streamer server 308 in Figure 3) and the video (shown as having been output by splitter 302 in Figure 3) for as long as possible. For example, maintaining independence between the video and the enhanced video until they are received at multiplexer 314 may facilitate trouble-shooting activities in the event of component or device failure. Furthermore, the network or service provider may want to ensure that the video that is associated with the output video produced by multiplexer 314 can be provided to the user device 332 irrespective of application data (e.g., triggers) that may be included in the enhanced video - this may be particularly true when the application or the enhanced video is generated by a third-party developer, and / or when the network or service provider has limited control over the application or the enhanced video. Maintaining isolation or independence between the enhanced video and the video ( or other data) may help to ensure that at least the video is provided to the user device 332 if the enhanced video has design bugs or flaws associated with it, or fails in some other way. Figure 4 illustrates an example method that may be used to implement one or more aspects of this disclosure. The method may be operative on any number of environments or architectures, such as the environments and architectures described above with respect to Figures 1-3. The method may be adapted to suit various environments and architectures. In step 402, an input identifying one or more frames ( or one or more portions thereof) may be received. The input may serve to identify that an event or an action should be taken by one or more applications running or executing at a device, such as a user device relative to the one or more frames, for example. In step 408, one or more feeds or representations thereof may be received. In some embodiments, the one or more feeds may include audio content ( e.g., music, a siren), visual content (e.g., a text file, a presentation, etc.), audio / visual content (e.g., a television show or program), or other data. In step 414, a comparison may take place to determine whether a match exists. For example, a match may exist if a frame included in the feed received in connection with step 408 corresponds to a frame identified in connection with step 402. In some embodiments, tolerances or thresholds may be used to determine whether a match exists. For example, a 12 Date Re9ue / Date Received 2021-06-14 match may exist if a frame included in the feed received in connection with step 408 corresponds to a frame identified in connection with step 402 within y¾. In some embodiments, the comparison or detection may be based on one or more "audio" frames. For example, audio may be monitored for a particular sequence of sounds. In the context of a football game, audio corresponding to the play-by-play may be monitored for a statement similar to (e.g., within a threshold of): "Team 'GHI' just scored a field goal - 3 points!" In some embodiments, the comparison or determination associated with step 414 may be associated with a timeout or expiration. Continuing the above example, if the football game has ended, or team GHI does not have possession of the ball, the monitoring may be stopped or cutoff so as to reduce the likelihood that a "false positive" will be triggered in response to a "similar enough" frame being detected (e.g., in another show, or as a result of team 'JKL' having scored a field goal). If a match does not exist (e.g., the NO path is taken out of step 414), then the method flow may proceed (back) to step 408 to continue receiving and monitoring the feed. In this respect, a loop may be established to monitor a received feed until a match occurs. If a match does exist (e.g., the YES path is taken out of step 414), then the method flow may proceed to step 420. In step 420, one or more triggers may be generated or otherwise associated with the frames or content. The one or more triggers may be of any type or combination of types. The one or more triggers may direct a client application executing or running at a device (e.g., a user device) to take one or more actions. As part of step 420, enhanced video may be generated. The enhanced video may include the one or more triggers. The enhanced video may include a blue-screen or dummy video. The enhanced video may include timing information. Referring to the example provided above regarding monitoring audio play-by-play for a team GHI field goal, in response to having detected the field goal, a pop-up box may be generated, transmitted, and / or displayed that provides statistics regarding team GHI (e.g., team GHI's placekicker's accuracy on field goal attempts from various distances). In step 426, one or more outputs may be generated. The one or more outputs may include video in some embodiments. The one or more outputs may include a combination (e.g., multiplexing) of content and triggers in some embodiments. As part of step 426, the 13 Date Re9ue / Date Received 2021-06-14 generated output(s) may be transmitted to one or more devices, such as one or more user devices. The method flow may return to step 408 for purposes of continuing to monitor the received feed. The method described above in connection with Figure 4 is illustrative. In some embodiments, some of the steps ( or portions thereof) may be optional. In some embodiments, the order of the steps ( or portions thereof) may be rearranged or executed in a sequence different from what is shown. In some embodiments, one or more of the steps ( or portions thereof) may execute in parallel. In some embodiments, additional steps not shown may be included. While some examples have been described above in the context of television technology and communications, aspects of this disclosure may readily be applied to, and adapted to be operative on, one or more other communication systems. Those communication systems may include computer networks, satellite networks, cellular networks, and the like. Although not required, various aspects described herein may be embodied as a method, a data processing system, and / or as a transitory and / or non-transitory computerreadable medium storing executable instructions. Accordingly, those aspects may take the form of an entirely hardware embodiment, an entirely software embodiment, an entirely firmware embodiment, or an embodiment combining software, firmware, and / or hardware. The functionality may be resident in a single computing device or application, or may be distributed across multiple computing devices / platforms or applications, the multiple computing devices / platforms optionally being connected to one another via one or more networks. Moreover, the structural components described herein may be distributed amongst one or more devices, optionally within a common housing or casing. Various signals representing content, data, or events as described herein may be transferred between a source and a destination in the form of electromagnetic waves traveling through signal-conducting media such as metal wires, optical fibers, and / or wireless transmission media (e.g., air and / or space). The various methods and acts may be operative across one or more computing servers and one or more networks. The functionality may be distributed in any manner, or may be located in a single computing device (e.g., a server, a client computer, etc.). As described 14 Date Re9ue / Date Received 2021-06-14 herein, one or more triggers may be generated in response to one or more frames ( or one or more portions of one or more frames) matching a frame (or portion thereof), optionally within a specified threshold or tolerance. In this manner, applications may be authored or provided in an easy and intuitive way. The methodological acts and processes described herein may be tied to particular machines or apparatuses. For example, as described herein, applications may execute on one or more devices, such as servers and user devices. The applications may be formatted in accordance with one or more communication techniques, specifications, types, or protocols. More generally, one or more apparatuses may include one or more processors and memory storing instructions, that when executed, cause the one or more apparatuses to perform the methodological acts and processes described herein. Furthermore, the methodological acts and processes described herein may perform a variety of functions including transforming an article (e.g., a feed, such as a content feed, and an application, such as a client application) into a different state or thing (e.g., content supplemented by an application with triggers based at least in part on a determination that a frame matches a specified frame, optionally within a given tolerance or threshold). Aspects of the disclosure have been described in terms of illustrative embodiments thereof. While illustrative systems and methods as described herein embodying various aspects of the present disclosure are shown, it will be understood by those skilled in the art, that the disclosure is not limited to these embodiments. Modifications may be made by those skilled in the art, particularly in light of the foregoing teachings. For example, each of the features of the aforementioned illustrative examples may be utilized alone or in combination or subcombination with elements of the other examples. For example, any of the above described systems and methods or parts thereof may be combined with the other methods and systems or parts thereof described above in any order. It will also be appreciated and understood that modifications may be made without departing from the true scope of the present disclosure. The description is thus to be regarded as illustrative instead of restrictive on the present disclosure. 15 Date Re9ue / Date Received 2021-06-14

Claims

CLAIMS:

1. A method comprising: receiving, by a computing device, a content feed; receiving an application comprising a trigger that causes the application to perform an action; and multiplexing the content feed with the trigger to generate an output, wherein timing of the trigger within the output is based on determining that a frame of the content feed matches a reference frame.

2. The method of claim 1, comprising: receiving enhanced video comprising the application and the trigger; and combining the content feed and the enhanced video, wherein the output comprises the content feed and the enhanced video comprising the application and the trigger.

3. The method of claim 2, wherein the output corresponds to an enhanced moving picture experts group (MPEG) video stream.

4. The method of any one of claims 1-3, wherein the application comprises an electronic programming guide.

5. The method of any one of claims 1-4, wherein the action is an action of the application, and the method comprises: using a rules engine to determine the action of the application to be triggered by the trigger. 16 Date Re9ue / Date Received 2023-09-25 6. The method of any one of claims 1-5, wherein the application is associated with a particular channel, and the method comprises: transmitting the output via an in-band communication that ensures that the application cannot be accessed from a channel different than the particular channel.

7. The method of any one of claims 1-6, comprising: transmitting the output via an out-of-band communication, which allows the application to be accessed regardless of what channel is being accessed by a user device accessing the application.

8. The method of any one of claims 1-7, wherein the output comprises timing information for synchronizing the trigger with the output.

9. The method of any one of claims 1-8, comprising: transmitting a hash of the reference frame to a user device; and activating, by the user device, the trigger in response to determining a match between the hash of the reference frame and a different hash of the frame of the content feed.

10. The method of claim 9, wherein the determining the match between the hash of the reference frame and the different hash of the frame of the content feed comprises determining that the hash of the reference frame and the different hash of the frame of the content feed are similar within a threshold.

11. The method of claim 9, wherein the determining the match between the hash of the reference frame and the different hash of the frame of the content feed comprises determining the match between the hash of the reference frame and the different hash of the frame of the content feed using one or more eigenvectors.

12. The method of any one of claims 1-11, wherein the frame of the content feed is associated with an expiration time after which monitoring for the reference frame is stopped. 17 Date Re9ue / Date Received 2023-09-25 13. The method of any one of claims 1-12, comprising: discarding at least one of blue-screen and dummy video included in the content feed; and using the at least one of the blue-screen and the dummy video in a troubleshooting process.

14. The method of any one of claims 1-13, comprising: generating video frame information associated with application information about the application, wherein the output includes the video frame information.

15. A computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to perform the method of any one of claims 1-14.

16. A non-transitory computer-readable media comprising instructions that, when executed, cause a computing device to perform the method of any one of claims 1-14. 1 7. A system comprising: a computing device configured to perform the method of any one of claims 1-14; and a second computing device configured to receive the output.

18. A method comprising: receiving, by a computing device, an input comprising one or more frames, wherein the input identifies an action to be taken by one or more applications; receiving one or more feeds, the one or more feeds comprising one or more of audio content, visual content, and audiovisual content; comparing a frame of the one or more feeds with a frame of the one or more frames, wherein the comparing comprises determining a similarity between the frame of the one or more feeds and the frame of the one or more frames within a threshold; 18 Date Re9ue / Date Received 2023-09-25 in response to determining the similarity within the threshold, associating a trigger with the frame of the one or more feeds, wherein the trigger triggers the action to be taken by the one or more applications; generating an enhanced video comprising the trigger; and transmitting the enhanced video.

19. The method of claim 18, wherein the enhanced video comprises an application.

20. The method of any one of claims 18 or 19, wherein the determining the similarity between the frame of the one or more feeds and the frame of the one or more frames comprises performing a pixel comparison between the frame of the one or more feeds and the frame of the one or more frames.

21. A computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to perform the method of any one of claims 18-20.

22. A non-transitory computer-readable media comprising instructions that, when executed, cause a computing device to perform the method of any one of claims 18-20.

23. A system comprising: a computing device configured to perform the method of any one of claims 18-20; and a second computing device configured to receive the enhanced video.

24. A method comprising: receiving, by a computing device, a content feed; receiving an advertisement comprising a trigger that causes the advertisement to be presented; causing a comparison of the trigger and at least one content frame of the content feed, wherein the comparison comprises determining whether a first plurality of predetermined pixels 19 Date Re9ue / Date Received 2023-09-25 corresponding to the trigger and a subset of a second plurality of pixels of the at least one content frame match based on a predetermined threshold; determining, based on the comparison, that a match exists between the trigger and the at least one content frame; and inserting, based on determining that the match exits, the trigger into the content feed.

25. The method of claim 24, wherein the advertisement is an application, and wherein the trigger causes the application to execute.

26. The method of any one of claims 24 or 25, wherein receiving the advertisement comprising the trigger further comprises receiving enhanced video comprising the advertisement, and wherein inserting the trigger into the content feed comprises combining the content feed and the enhanced video.

27. The method of claim 26, wherein the content feed corresponds to a moving picture experts group (MPEG) video stream.

28. The method of any one of claims 24-27, wherein the predetermined threshold comprises a percentage difference between the first plurality of predetermined pixels and the subset of the second plurality of pixels.

29. The method of any one of claims 24-28, wherein the content feed comprises timing information for the trigger.

30. The method of any one of claims 24-29, wherein the comparison comprises comparing a first hash of the trigger and a second hash of the at least one content frame.

31. The method of claim 30, wherein comparing the first hash of the trigger and the second hash of the at least one content frame comprises determining that the first hash and the second hash match based on a predetermined tolerance. 20 Date Re9ue / Date Received 2023-09-25 32. The method of claim 30, wherein comparing the first hash of the trigger and the second hash of the at least one content frame comprises determining that the first hash and the second hash match using one or more eigenvectors.

33. The method of any one of claims 24-32, further comprising: initiating a troubleshooting process, wherein the troubleshooting process is associated with at least one of a blue-screen video and a dummy video included in the content feed.

34. The method of any one of claims 24-33, further comprising: generating video frame information associated with advertisement information corresponding to the advertisement, wherein inserting the trigger into the content feed further comprises inserting the video frame information into the content feed.

35. A computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to perform the method of any one of claims 24-34.

36. A non-transitory computer-readable media comprising instructions that, when executed, cause a computing device to perform the method of any one of claims 24-34. 3 7. A system comprising: a computing device configured to perform the method of any one of claims 24-34; and a second computing device configured to receive the content feed.

38. A method comprising: receiving, by a computing device, an input comprising one or more reference frames, wherein the input is associated with one or more advertisements; 21 Date Re9ue / Date Received 2023-09-25 receiving one or more feeds, the one or more feeds comprising one or more of audio content, visual content, and audiovisual content; causing a comparison of one or more content frames of the one or more feeds with the one or more reference frames, wherein the comparison comprises determining whether a first plurality of predetermined pixels corresponding to a trigger for the one or more advertisements and a subset of a second plurality of pixels of the one or more content frames match based on a predetermined threshold; associating, based on determining that a metric associated with the comparison satisfies a threshold, the trigger with the one or more content frames, wherein the trigger causes presentation of the one or more advertisements; and transmitting an enhanced video comprising the trigger and the one or more feeds.

39. The method of claim 38, wherein the enhanced video comprises the one or more advertisements.

40. The method of any one of claims 38 or 39, wherein the comparison further comprises comparing a first hash of the one or more reference frames and a second hash of the one or more content frames.

41. A computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to perform the method of any one of claims 38-40.

42. A non-transitory computer-readable media comprising instructions that, when executed, cause a computing device to perform the method of any one of claims 38-40.

43. A system comprising: a computing device configured to perform the method of any one of claims 38-40; and a second computing device configured to receive the enhanced video. 22 Date Re9ue / Date Received 2023-09-25 44. A method comprising: receiving, by a splitter, a content feed comprising video content; splitting, by the splitter, the content feed into at least two video outputs comprising a first video output and a second video output, the first video output being provided to a streamer server, and the second video output being provided to a multiplexer; receiving, by the streamer server, an input specifying one or more video frames and a trigger, wherein the trigger is a stacked trigger comprising a signal to an application that causes the application to perform a first action in response to at least a first condition and a second condition being met, the first condition specifying the presence in the first video output of a first frame of the one or more video frames, and the second condition specifying the presence or absence in the first video output of a second frame of the one or more video frames; determining, by the streamer server, that the first condition and the second condition are met by detecting the presence of the first frame in the first video output as specified by the first condition, and by detecting the presence or absence of the second frame in the first video output, as specified by the second condition, the detecting being based on comparison of specified first and / or second video frames with video frames in the first video output; generating, by the streamer server, the trigger automatically in response to determining that the first condition and the second condition are met; and transmitting, by the streamer server, an output comprising the trigger to the multiplexer, the multiplexer being configured to combine the output comprising the trigger with the second video output to produce an enhanced video output for transmission to a user device.

45. The method of claim 44, wherein the trigger comprises a do-it-now trigger, such that the application performs a task upon receipt of the trigger.

46. The method of any one of claims 44 or 45, wherein the trigger comprises a specification of an offset, wherein the offset is specified relative to one of a certain time and an occurrence of an event comprising a reception of a user input. 23 Date Re9ue / Date Received 2023-09-25 47. The method of any one of claims 44-46, further comprising: transmitting, by the multiplexer, the enhanced video to the user device.

48. The method of any one of claims 44-4 7, wherein the determining that the first condition and the second condition are met comprises detecting one of the one or more video frames before or after another of the one or more video frames within a specified amount of time in the first video output.

49. The method of any one of claims 44-48, wherein the determining that the first condition and the second condition are met comprises detecting in the first video output at least a subset of the one or more video frames.

50. The method of any one of claims 44-49, wherein the trigger comprises a cancel-trigger directing the application to terminate.

51. The method of claim 50, wherein the trigger causes the application to replace first data with second data in response to determining that the first condition and the second condition are met.

52. The method of any one of claims 44-51, wherein the video content is an encoded MPEG video.

53. A computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to perform the method of any one of claims 44-52.

54. A non-transitory computer-readable media comprising instructions that, when executed, cause a computing device to perform the method of any one of claims 44-52. 24 Date Re9ue / Date Received 2023-09-25 55. A system comprising: a computing device configured to perform the method of any one of claims 44-52; and a second computing device configured to receive the output.

56. A method comprising: determining a match between a trigger for a content item and at least one content frame in a stream; and based on a time associated with the match, inserting the trigger for the content item in the stream.

57. The method of claim 56, wherein inserting the trigger for the content item in the stream comprises replacing, based on the time associated with the match, a first content item in the stream with a second content item in the stream.

58. The method of any one of claims 56 or 57, wherein determining the match comprises comparing a first plurality of pixels associated with the trigger for the content item and a second plurality of pixels associated with the at least one content frame.

59. The method of any one of claims 56-58, wherein determining the match comprises comparing first audio associated with the trigger for the content item and second audio associated with the at least one content frame.

60. The method of any one of claims 56-59, wherein determining the match comprises comparing the trigger for the content item and the at least one content frame using a fuzzy recognition algorithm.

61. The method of any one of claims 56-60, wherein determining the match comprises comparing a first hash associated with the trigger for the content item and a second hash associated with the at least one content frame. 25 Date Re9ue / Date Received 2023-09-25 62. The method of any one of claims 56-61, wherein determining the match comprises detecting, using a facial recognition algorithm, a face in the at least one content frame.

63. A computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to perform the method of any one of claims 56-62.

64. A non-transitory computer-readable media comprising instructions that, when executed, cause a computing device to perform the method of any one of claims 56-62.

65. A system comprising: a computing device configured to perform the method of any one of claims 56-62; and a second computing device configured to receive the stream. 26 Date Re9ue / Date Received 2023-09-25