Methods, systems, and media for interacting with content using a second screen device

Abstract

The present disclosure relates to methods, systems, and media for interacting with content using a second screen device. In some embodiments, the method includes: receiving a request to present a media content item from a remote media streaming device; sending interactive content as a video stream to the media streaming device over the Internet; causing the interactive content to be presented by the media streaming device; causing a notification to be sent to a computing device associated with the media streaming device indicating that the content being presented by the media streaming device is interactive content; receiving instructions from the computing device to control how objects depicted in the interactive content are presented; updating the interactive content based on the instructions; sending the updated interactive content as a video stream to the media streaming device; and causing the updated interactive content to be presented by the media streaming device.

Description

[0001] Description of the case

[0002] This application is a divisional application of Chinese invention patent application No. 201680078757.X, filed on December 7, 2016.

[0003] CROSS-REFERENCE TO RELATED APPLICATIONS

[0004] This application claims the benefit of U.S. Patent Application No. 15 / 132,908, filed April 19, 2016, which is incorporated herein by reference in its entirety. Technical Field

[0005] Methods, systems, and media are provided herein for interacting with content using a second screen device. Background Art

[0006] Streaming media devices are often used to present streaming media content, such as movies, user-generated videos, etc., on a television. This content is often limited to non-interactive content, and devices that stream interactive content (such as gaming devices) require dedicated devices to interact with the game. However, it is desirable to be able to provide interactive content related to non-interactive content, such as movies or videos, that can be controlled by a user through a device, such as a smartphone.

[0007] Thus, provided herein are methods, systems, and media for interacting with content using a second screen device. Summary of the Invention

[0008] According to some implementations of the disclosed subject matter, mechanisms are provided for interacting with content using a second screen device.

[0009] According to some embodiments of the disclosed subject matter, a method for interacting with content using a second screen device is provided, the method comprising: receiving a request to present one or more media content items from a remote media streaming device; sending interactive content as a video stream to the media streaming device over the Internet based on the request to present the one or more media content items; causing the interactive content to be presented by the media streaming device; causing a notification to be sent to a computing device associated with the media streaming device indicating that the content being presented by the media streaming device is interactive content; receiving instructions from the computing device to control how objects depicted in the interactive content are presented; updating the interactive content based on the instructions; sending the updated interactive content as a video stream to the media streaming device; and causing the updated interactive content to be presented by the media streaming device.

[0010] According to some embodiments of the disclosed subject matter, a system for interacting with content using a second screen device is provided, the system comprising a hardware processor programmed to: receive a request to present one or more media content items from a remote media streaming device; send interactive content as a video stream to the media streaming device over the Internet based on the request to present the one or more media content items; cause the interactive content to be presented by the media streaming device; cause a notification to be sent to a computing device associated with the media streaming device indicating that the content being presented by the media streaming device is interactive content; receive instructions from the computing device to control how objects depicted in the interactive content are presented; update the interactive content based on the instructions; send the updated interactive content as a video stream to the media streaming device; and cause the updated interactive content to be presented by the media streaming device.

[0011] According to some implementations of the disclosed subject matter, the system may include one or more of a media streaming device, a computing device, a media display device, and a content delivery device, each of these devices having a hardware processor, and the steps in the preceding paragraphs are performed on one or more hardware processors of these devices.

[0012] According to some embodiments of the disclosed subject matter, a non-transitory computer-readable medium containing computer-executable instructions is provided, which, when executed by a processor, cause the processor to perform a method for interacting with content using a second screen device, the method comprising: receiving a request to present one or more media content items from a remote media streaming device; sending interactive content as a video stream to the media streaming device over the Internet based on the request to present the one or more media content items; causing the interactive content to be presented by the media streaming device; causing a notification to be sent to a computing device associated with the media streaming device indicating that the content being presented by the media streaming device is interactive content; receiving instructions from the computing device to control how objects depicted in the interactive content are presented; updating the interactive content based on the instructions; sending the updated interactive content as a video stream to the media streaming device; and causing the updated interactive content to be presented by the media streaming device.

[0013] According to some embodiments of the disclosed subject matter, a system for interacting with content using a second screen device is provided, the system comprising: a device for receiving a request to present one or more media content items from a remote media streaming device; a device for sending interactive content as a video stream to the media streaming device over the Internet based on the request to present the one or more media content items; a device for causing the interactive content to be presented by the media streaming device; a device for causing a notification to be sent to a computing device associated with the media streaming device indicating that the content being presented by the media streaming device is interactive content; a device for receiving instructions from the computing device to control how objects depicted in the interactive content are presented; a device for updating the interactive content based on the instructions; a device for sending the updated interactive content as a video stream to the media streaming device; and a device for causing the updated interactive content to be presented by the media streaming device.

[0014] In some implementations, the computing device causes the media streaming device to request the one or more content items.

[0015] In some implementations, the request to present one or more media content items is associated with an application installed on the computing device, and wherein the notification is associated with the application.

[0016] In some embodiments, the instructions include instructions to rotate the object.

[0017] In some implementations, the interactive content does not correspond to any of the one or more media content items.

[0018] In some implementations, the interactive content is an advertisement. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Various objects, features, and advantages of the disclosed subject matter may be more fully understood by reference to the following detailed description of the disclosed subject matter when considered in conjunction with the accompanying drawings, wherein like reference numerals represent like elements.

[0020] Figure 1A and 1B

[0014] An example of a system for interacting with content using a second screen device is shown in accordance with some implementations of the disclosed subject matter.

[0021] Figure 2 An example of a general schematic diagram illustrating a system on which mechanisms for interacting with content using a second screen device as described herein may be implemented, according to some implementations of the disclosed subject matter.

[0022] Figure 3Shows some embodiments of the disclosed subject matter that can be used to implement Figure 2 An example of hardware for one of the computing devices, one of the media streaming devices, and a content delivery server is depicted in FIG.

[0023] Figure 4

[0014] An example of a process for interacting with content using a second screen device is shown in accordance with some implementations of the disclosed subject matter.

[0024] Figure 5A and 5B An example of the flow of information between a computing device, a media receiving device, and a content delivery server is shown in accordance with some implementations of the disclosed subject matter. DETAILED DESCRIPTION

[0025] According to some implementations of the disclosed subject matter, mechanisms (which may include methods, systems, and media) are provided for interacting with content using a second screen device.

[0026] In some embodiments, the mechanisms described herein can facilitate using a second screen device to interact with interactive content presented by a media receiving device. In some embodiments, when the media receiving device is presenting interactive content associated with a media item to be presented by the media receiving device, the mechanisms described herein can send a notification to the second screen device. For example, when the media receiving device presents an interactive advertisement before presenting a video selected by a user using a smartphone, the mechanisms described herein can send a push notification to the smartphone to alert the user to the interactivity of the content.

[0027] In some implementations, after the second screen device detects that a particular action or series of actions has been performed, the second screen device can begin providing instructions for controlling the interactive content. For example, when a smartphone receives a notification, the smartphone can detect that the user has picked up the smartphone and can begin providing instructions for controlling the interactive advertisement.

[0028] In some implementations, the mechanisms described herein can provide updated interactive content based on instructions received from a second screen device. For example, in response to a smartphone detecting a specific movement, such as a rotation of the smartphone, the smartphone can provide instructions to a server generating interactive content to rotate the product shown in the advertisement. In such an example, the server can receive the instructions to rotate the product and can update the video being streamed to the media receiving device to reflect the instructions received from the smartphone.

[0029] Go to Figure 1A, shows an example 100 of a system for interacting with content using a second screen device in accordance with some implementations of the disclosed subject matter. In some implementations, system 100 can include a media streaming device 102, which can include an input / output connector 104. Input / output connector 104 can be any suitable input and / or output connector for communicating with a media playback device 106. For example, input / output connector 104 can be a High-Definition Multimedia Interface (HDMI) port, a Universal Serial Bus (USB) connector (e.g., a USB 3.0 connector), a Thunderbolt connector, a Digital Visual Interface (DVI) connector, a TOSLINK connector (e.g., an optical audio connector), a Standalone Video (S-Video) connector, any other suitable connector, and / or any suitable combination of connectors.

[0030] In some embodiments, media playback device 106 can be a display device comprising hardware and / or software for presenting the media received from one or more media content sources. For example, media playback device 106 can comprise television, smart TV, monitor, set-top box, audio video (AV) receiver, any other suitable media playback device and / or its any suitable combination. More specifically, media playback device 106 can comprise display 108, loudspeaker, hardware and / or software, power supply etc. for presenting the media content such as analog and / or digital video and / or audio data. Media playback device 106 can comprise the various input ports for receiving the video and / or audio data from various sources. Such input port can comprise one or more HDMI ports, one or more component video ports, one or more composite video ports, one or more USB ports, one or more S-video ports, one or more TOSLINK ports, one or more coaxial ports, one or more Ethernet ports (no matter whether wired or wireless) etc.

[0031] In some embodiments, the media streaming device 102 can be connected to the media playback device 106 via a connection 110. The media streaming device 102 and the media playback device 106 can be connected using any suitable technology. For example, the connection 110 can include a plug of the input / output connector 104 of the media streaming device 102 that is inserted into a corresponding receptacle port of the media playback device 106. As another example, a suitable cable, such as an HDMI cable, can be connected between the input / output connector 104 and a port of the media playback device 106. Additionally or alternatively, the media streaming device 102 can be included as hardware and / or software of the media playback device 106.

[0032] In some implementations, the media streaming device 102 can be coupled to a computing device 112 using a communication link 114. The computing device 112 can be any suitable computing device, such as a smartphone, a tablet computer, a wearable computer, a laptop computer, a personal computer, an e-reader, a digital media receiver, a smart TV, a game console, any other suitable computing device, or any suitable combination thereof. In some implementations, the communication link 114 can include any suitable communication link, such as described below with respect to Figure 2 Described. In addition, the communication link 114 can include a network, such as a local area network (LAN) with wired and / or wireless connections. Additionally or alternatively, the communication link 114 can include a wireless connection between the computing device 112 and the media streaming device 102, such as an ad hoc wireless network connection, a short-range wireless communication protocol (e.g., Bluetooth, Bluetooth Low Energy, Wireless USB, etc.). In some embodiments, the communication between the computing device 112 and the media streaming device 102 over the communication link 114 can be encrypted using any suitable encryption technology. For example, a message sent from the computing device 112 to the media streaming device 114 can be encrypted using any suitable encryption scheme, for example, using a public key-private key pair for encrypting and decrypting messages. As another example, the communication on the communication link 114 can be encrypted using Transport Layer Security (TLS).

[0033] In some implementations, computing device 112 may include a display 116 for presenting a user interface to a user. In some examples described herein, computing device 112 may be a mobile computing device such as a smartphone or tablet computer, and display 116 may include a touch screen for receiving input and displaying a user interface and / or media content to the user. Figure 3 As depicted, computing device 112 may include any suitable sensor, such as an accelerometer, a gyroscope, an electronic compass, and the like.

[0034] In some embodiments, computing device 112 can communicate with content discovery server 122 via communication link 126. Computing device 112 can communicate with content discovery server 122 to discover and / or browse content available to content delivery server 120. For example, a user can use computing device 112 to interact with content discovery server 122 to find media content to be presented. In some embodiments, such media content can be presented using display 116 of computing device 112. In some embodiments, computing device 112 can present media content items selected using content discovery server 122 by requesting the media content items from content delivery server 120 and receiving the media content items via communication link 124. In some embodiments, each of content delivery server 120 and / or content discovery server 122 can be implemented on any suitable number of servers. Additionally or alternatively, in some embodiments, the functions performed by content delivery server 120 and content discovery server 122 can be performed by the same device (e.g., via a common server computer). In some embodiments, multiple content delivery servers can provide content to computing device 112 in response to a request for content. For example, in response to a request for a particular media content item from computing device 112, content delivery server 120 may cause advertisements to be provided to computing device 112 before, during, and / or after presentation of the requested content item. In such an example, the server that provides the advertisements may be separate from the server that provides the requested media content item.

[0035] In some embodiments, communication links 124 and / or 126 may comprise a local area network (e.g., a home network) and / or a non-local network (e.g., the Internet). For example, computing device 112 may be connected to a public LAN, such as a home network, and may be connected to content discovery server 122 and / or content delivery server 120 via the Internet. As another example, content delivery server 120 and / or content discovery server 122 may be connected to a LAN shared by computing devices 112. In a more specific example, content delivery server 120 and / or content discovery server 122 may be located remotely from computing device 112, and communication links 124 and / or 126 may comprise a non-local network, such as the Internet, for accessing content from content delivery server 120 and / or discovering content using content discovery server 122. In another more specific example, content delivery server 120 and / or content discovery server 122 may be located locally to computing device 112, and communication links 124 and / or 126 may comprise a local network, such as a home network, to which content delivery server 120 and / or content discovery server 122 is connected. In such examples, the non-local networks of communication links 124 and / or 126 , if present, may not be used when accessing content from content delivery server 120 and / or discovering content using content discovery server 122 .

[0036] In some implementations, a user of the computing device 112 can cause media content available from the content delivery server 120 to be transmitted to the media streaming device 102, which in turn can cause the media content to be presented on the display 108 of the media playback device 106 to which the media streaming device 102 is connected. In some implementations, the media streaming device 102 can receive power from the media playback device 106 via the connection 110 and can only be used to receive media content when power is being received via the connection 110 (e.g., when the port to which the media streaming device 102 is connected is selected as the active input port).

[0037] In some implementations, if the user has selected a media content item to be presented from the content delivery server 120 , the user may select an icon presented to the user associated with the selected media content item to cause the media content item to be presented using the media streaming device 102 and the media playback device 106 .

[0038] In some embodiments, when a media content item is to be presented from a content delivery server 120 using the media streaming device 102, the media content item can be transmitted to the media streaming device 102 via a communication link 128. The communication link 128 can include a local area network (e.g., a home network) and / or a non-local network (e.g., the Internet). For example, the media streaming device 102 and the computing device 112 can both be connected to a public LAN such as a home network and can be connected to the content delivery server 120 via the Internet. As another example, the content delivery server 120 can be connected to a LAN shared by the computing device 112 and / or the media streaming device 102. In a more specific example, the content delivery server 120 can be located remotely from the media streaming device 102 and / or the computing device 112, and the communication link 128 can include a non-local network such as the Internet for accessing content from the content delivery server 120. In another more specific example, the content delivery server may be located locally at the media streaming device 102 and / or the computing device 112, and the communication link 128 may comprise a local network, such as a home network, to which both the media streaming device 102 and the content delivery server 120 are connected. In such an example, the non-local network of the communication link 128, if any, may not be used when accessing content from the content delivery server 120.

[0039] In some implementations, a user can select a media content item from the memory of computing device 112 to be presented using media streaming device 102 (e.g., a user can select a video stored locally on computing device 112). Additionally or alternatively, a user can select a media content item stored on another computing device on the same local area network (e.g., a network attached storage device, the memory of a personal computer on a home network, the memory of a server on the same network, etc.) to be presented using media streaming device 102. Such media content items stored on a computing device connected to the local area network can be transferred from computing device 112 to media receiver 102 via communication link 114 (or any other suitable communication link) without having to be transferred through content delivery server 120.

[0040] Figure 1B An example 150 of another system for interacting with content using a second screen device in accordance with some embodiments of the disclosed subject matter is shown. In some embodiments, the system 150 can include a digital media receiver 152, which can use any suitable input / output connector (e.g., as described above with respect to Figure 1A 104 and / or 110 described above) is connected to the media playback device 106. In some embodiments, the digital media receiver 152 can use the communication link 114 (e.g., as described above with respect to Figure 1A102 and computing device 112). In addition, in some embodiments, the digital media receiver 152 can be coupled to the computing device 112 via communication links 128 and / or 126, respectively (e.g., as described above with respect to the media streaming device 102 and computing device 112). Figure 1A and Figure 1B 1) to communicate with the content delivery server 120 and / or the content discovery server 122. In such an embodiment, the digital media receiver 152 may be used to browse content based on instructions received from the computing device 112 and / or any other suitable device (e.g., such as a remote control associated with the media streaming device 152), thereby using the media playback device 106 to control a user interface presented by the digital media receiver 152.

[0041] In some implementations, one or more media content items may be selected for use using computing device 112 (e.g., as described above with respect to Figure 1A ) presentation, and computing device 112 may communicate the selection to digital media receiver 152 and / or content delivery server 120 to be pushed to digital media receiver 152.

[0042] Figure 2 An example 200 of a general schematic diagram of a system according to some embodiments of the disclosed subject matter is shown on which a mechanism for interacting with content using a second screen device as described herein can be implemented. As shown, the system 200 can include one or more computing devices 112. The computing devices 112 can be local to each other or remote from each other. The computing devices 112 can be connected to a communication network 204 via one or more communication links 202, which can be linked to a media streaming device 102 via a communication link 206, to a content delivery server 120 via a communication link 208, to a digital media receiver 152 via a communication link 210, to a content discovery server 122 via a communication link 212, to other computing devices 112 via a communication link 202, and to a remote control 130 via a communication link 210.

[0043] In some implementations, each of the computing device 112, the content delivery server 120, the content discovery server 122, the media streaming device 102, and the digital media receiver 152 may be any of a general-purpose device such as a computer or a dedicated device such as a client, a server, etc. Any of these general-purpose or dedicated devices may include any suitable components, such as a hardware processor (which may be a microprocessor, a digital signal processor, a controller, etc.), memory, a communication interface, a display controller, an input device, etc. For example, the computing device 112 may be implemented as a smartphone, a tablet computer, a wearable computer, a personal computer, a laptop computer, a game console, a digital media receiver, a set-top box, a smart TV, a server, etc.

[0044] The communication network 204 may be any suitable computer network or combination of such networks, including the Internet, an intranet, a wide area network (WAN), a local area network (LAN), a wireless network, a digital subscriber line (DSL) network, a frame relay network, an asynchronous transfer mode (ATM) network, a virtual private network (VPN), etc. The communication links 202, 206, 208, and 212 may be any communication links suitable for communicating data among the computing device 112, the media streaming device 102, the content delivery server 120, the content discovery server 122, and the remote control 130, such as network links, dial-up links, wireless links, hard-wired links, any other suitable communication links, or any suitable combination of such links. The computing device 112 may use any suitable technology to discover, browse, download, stream, store, play back, transmit, and / or otherwise present content stored locally on the computing device 112 and / or remotely at the content delivery server 120.

[0045] System 200 may include the Figure 1A The media streaming device 102 described and / or as described above with respect to Figure 1B The digital media receiver 152 is described and may include a media receiving application 214 installed on and / or executed by one or more of the media playback devices 106 that may replicate the functionality of the media streaming device 102 and / or the digital media receiver 152.

[0046] System 200 may include one or more content delivery servers 120. Content delivery server 120 may be any suitable server, such as a processor, computer, data processing device, and / or any suitable combination of such devices, that provides access to media content items according to the mechanisms described herein.

[0047] System 200 may include one or more content discovery servers 122. Content discovery server 122 may be any suitable server, such as a processor, a computer, a data processing device, and / or any suitable combination of such devices, for facilitating discovery and / or browsing of media content items accessible on content delivery server 120 in accordance with the mechanisms described herein.

[0048] In some embodiments, the above Figure 1A and Figure 1B The communication link 114 described may include a communication link 202, a communication network 204, and a communication link 206; Figure 1A The communication link 124 described may include a communication link 202, a communication network 204, and a communication link 208; Figure 1A and Figure 1B The communication link 126 described may include a communication link 202, a communication network 204, and a communication link 212; and Figure 1A and Figure 1B The depicted communication link 128 may include communication link 206 , communication network 204 , and communication link 208 .

[0049] Figure 3 Shows some embodiments of the disclosed subject matter that can be used to implement Figure 2 An example 300 of the hardware of the computing device 112, the media streaming device 102, and the content delivery server 120 is depicted in FIG. Figure 3 , the computing device 112 may include a hardware processor 312, a display / input device 314, a memory 316, and a transmitter / receiver 318, which may be interconnected. In some implementations, the memory 316 may include a storage device (such as a non-transitory computer-readable medium) for storing a computer program for controlling the hardware processor 312.

[0050] The hardware processor 312 can use a computer program to present media content and / or use an interface on the display / input device 314, wherein the interface particularly allows a user to cause the media content presented on the display / input device 314 to be presented on a media receiving device, such as the media streaming device 102. It should also be noted that the data received by the communication link 202 and / or any other communication link can be received from any suitable source. In some embodiments, the hardware processor 312 can use, for example, a transmitter, a receiver, a transmitter / receiver, a transceiver or any other suitable communication device such as a transmitter / receiver 318 to send and receive data via the communication link 202 and / or any other communication link. The display / input device 314 can include a touch screen, a flat panel display, a cathode ray tube display, a projector, a speaker and / or any other suitable display and / or presentation device, and can further include a computer keyboard, a computer mouse, a microphone, a touch pad, a voice recognition circuit, a touch interface for a touch screen and / or any other suitable input device. Additionally, in some implementations, display / input device 314 may include sensors that detect movement of the computing device, such as one or more accelerometers that can detect translation of computing device 112, one or more gyroscopes that can detect rotation of computing device 112 about one or more axes, and / or any other suitable sensor that can detect any suitable movement of computing device 112. Transmitter / receiver 318 may include any suitable transmitter and / or receiver for transmitting and / or receiving media content, including, among other things, audio and / or video content.

[0051] The media streaming device 102 may include a hardware processor 322, a display output 324, a memory 326, and a transmitter / receiver 328, which may be interconnected. In some implementations, the memory 326 may include a storage device (such as a non-transitory computer-readable medium) for storing a computer program for controlling the hardware processor 322.

[0052] The hardware processor 322 can use a computer program to provide media content and / or a user interface to the display output 324 for presenting the media content and / or the user interface on the media playback device. It should also be noted that the data received by the communication link 206 or any other communication link can be received from any suitable source. In some embodiments, the hardware processor 322 can use, for example, a transmitter, a receiver, a transmitter / receiver, a transceiver or any other suitable communication device such as a transmitter / receiver 328 to send and receive data by way of the communication link 206 or any other communication link. The display output 324 can include hardware, software and / or firmware for outputting media content and / or a user interface to the media playback device (e.g., the media playback device 106) in any suitable format, and can include the hardware, software and / or firmware described above with respect to Figure 1AThe input / output connector 104 described above. The transmitter / receiver 328 can include any suitable transmitter and / or receiver for transmitting and / or receiving media content, including, in particular, audio and / or video content. In some embodiments, the digital media receiver 152 can be implemented using hardware similar to the media streaming device 102, but can include more or different programming and / or upgraded hardware than a content delivery server media streaming device.

[0053] The content delivery server 120 may include a hardware processor 332, a display / input device 334, a memory 336, and a transmitter / receiver 338, which may be interconnected. In some implementations, the memory 336 may include a storage device (such as a non-transitory computer-readable medium) for storing a server program for controlling the hardware processor 332.

[0054] The hardware processor 332 can use a server program to communicate with the computing device 112 and / or the media streaming device 102, and provide access to media content. It should also be noted that the data received via the communication link 208 or any other communication link can be received from any suitable source. In some embodiments, the hardware processor 332 can use, for example, a transmitter, a receiver, a transmitter / receiver, a transceiver, or any other suitable communication device such as a transmitter / receiver 338 to send and receive data via the communication link 208 or any other communication link. In some embodiments, the hardware processor 332 can receive commands and / or values ​​transmitted by one or more users. The display / input device 334 can include a touch screen, a flat panel display, a cathode ray tube display, a projector, a speaker, and / or any other suitable display and / or presentation device, and can further include a computer keyboard, a computer mouse, a microphone, a touchpad, a voice recognition circuit, a touch interface for a touch screen, and / or any other suitable input device. The transmitter / receiver 318 can include any suitable transmitter and / or receiver for transmitting and / or receiving media content, particularly including audio and / or video content.

[0055] In some embodiments, the content delivery server 120 can be implemented in one server or can be distributed across any suitable number of servers. For example, multiple servers 120 can be implemented in various locations to increase reliability and / or increase the speed at which the server 120 can communicate with the computing device 112 and / or the media receiving device 102.

[0056] In some implementations, content discovery server 122 may be implemented using similar hardware as content delivery server 120 , but may include server programs for facilitating discovery and / or browsing of media content items accessible to content delivery server 120 .

[0057] Figure 4 An example 400 of a process for interacting with content using a second screen device according to some implementations of the disclosed subject matter is shown. At 402, process 400 can receive a request to present one or more media content items using a media receiving device (e.g., media streaming device 102, digital media receiver 152, etc.). In some implementations, the request can be received from any suitable device. For example, as described above with respect to Figure 1A As described above with respect to the system 100, the computing device 112 may communicate identification information of one or more media content items, such as uniform resource locators (URLs), and their sources to the media streaming device 102 that may request the one or more media content items (e.g., from the content delivery server 120). Figure 1B As described with respect to system 150 , digital media receiver 152 may request one or more media content items (e.g., from content delivery server 120 ), and / or computing device 112 may request one or more media content items to be presented using digital media receiver 152 (e.g., by sending a request and information identifying digital media receiver 152 to content delivery server 120 ).

[0058] In some embodiments, the request can include any suitable information and can be for any suitable media content item. For example, the request can include identification information for one or more content items, such as a URL, a content identification number or other character sequence, one or more search terms, one or more characteristics of the content being requested (e.g., genre, artist, etc.). As another example, the request can be a request for a specific media content item, one or more media content items in response to a search, a stream of media content items corresponding to one or more artists or genres, etc.

[0059] In some implementations, the requested media content may include any suitable media content, such as video, audio, one or more images, one or more interactive content items, any other suitable media content, or any suitable combination thereof.

[0060] In some embodiments, computing device 112 can be used to browse content and / or communicate with media streaming device 102 and / or digital media receiver 152 using one or more applications and / or using the operating system of computing device 112. For example, in some embodiments, a user can browse content using a specific application installed on computing device 112 and / or being executed by computing device 112. In such an example, when the user finds a media content item (or multiple media content items, such as a playlist) that they want to consume, the user can provide input to computing device 112 to request the content through the application being used to browse content. Computing device 112 can request the content for presentation by computing device 112, can cause media streaming device 102 to request the content, can cause digital media receiver 152 to request the content, and / or can cause the content to be sent to digital media receiver 152. In some embodiments, the application used to browse content and the application used to present content on computing device 112 can be different applications. In some implementations, during presentation of content via computing device 112, a user may provide input to cause presentation of the content via media streaming device 102 and / or digital media receiver 152. Such input may be provided in association with a particular application used by computing device 112 for presenting the content and / or by an operating system of computing device 112.

[0061] In some implementations, the computing device 112 can be used to control the operation of the media streaming device 102 and / or the digital media receiver 152 via one or more applications. In such implementations, the applications used to control the operation of the media streaming device 102 and / or the digital media receiver 152 can be the same as or different from the applications described above for presenting content using the computing device 112.

[0062] At 404, process 400 can cause interactive content to be presented by the media receiving device based on a request for one or more media content items. In some embodiments, the interactive content can be included in the one or more media content items requested. Additionally or alternatively, in some embodiments, the interactive content can be an advertisement (e.g., as a pre-roll advertisement, an insert advertisement, a pre-roll advertisement, etc.) presented based on the request. For example, in response to a request for one or more content items, the content delivery server 120 can provide an advertisement containing the interactive content. As another example, in response to a request for one or more content items, the content delivery server 120 can cause an advertisement to be provided to the content delivery server 120 and / or the media receiving device from an advertising server (which can be implemented using any suitable components).

[0063] In some embodiments, the interactive content may include any suitable element that can manipulate at least one of them. For example, in some embodiments, the interactive content may be at least a portion of an advertisement that includes a representation of at least one product or service being advertised. In such an example, the representation may be manipulated by the user to provide an interactive experience via instructions provided from an associated computing device (e.g., computing device 112). In a more specific example, the interactive content may include models of products that the user can manipulate to show from different angles, different magnifications, and the like. In another more specific example, the interactive content may include models of multiple products available (e.g., product versions), and the user may select a model and manipulate the model to show it from different angles, different magnifications, and the like. As another more specific example, the interactive content may include a representation of an environment that the user can navigate by providing instructions via computing device 112. In such an example, the interactive content may provide an interactive tour through a resort, a golf course, and the like.

[0064] As another example, in some embodiments, interactive content can be provided as at least a portion of the requested one or more media content items. In a more specific example, interactive content can be provided in conjunction with a video to facilitate a user's exploration of an object or place depicted in the video in greater detail. In another more specific example, in a video reviewing a particular product, a model of the product can be provided as interactive content that the user can manipulate via instructions from user device 112.

[0065] At 406, in response to the interactive content being presented, process 400 can send a notification to a computing device associated with the media receiving device that received the request for the content. In some embodiments, the notification can indicate that the content currently being presented by the media receiving device is interactive content that can be manipulated using computing device 112. In some embodiments, the notification can be provided to the computing device using any suitable technology or combination of technologies. For example, process 400 can cause a push notification to be sent to computing device 112. In such an example, the push notification can be associated with a specific application, such as an application for requesting content items from computing device 112, and / or an application that can be used to control the operation of media streaming device 102 and / or digital media receiver 152. In some embodiments, the notification can be provided using tactile feedback (e.g., vibration) having any suitable mode, audio having any suitable mode, text, images, any other suitable content, or any suitable combination thereof.

[0066] In some implementations, the notification may include any suitable instructions for the user to follow in order to begin manipulating the interactive content. For example, the notification may include instructions to pick up computing device 112, mobile computing device 112, etc., in a particular manner and / or in a particular mode.

[0067] In some embodiments, in addition to and / or in lieu of sending a notification to a user device 112, other mechanisms can be used to initiate control of interactive content by a particular computing device 112. For example, in some embodiments, a QR code (and / or any other suitable machine-readable code) can be presented with the content, and capturing an image of the QR code can cause the computing device 112 to initiate control of the interactive content. As another example, an audio prompt can be provided that can cause the computing device 112 to perform one or more actions when the microphone of the computing device 112 detects the prompt. As another example, in some embodiments, the interactive content can include an indication that the content is interactive, and the user can initiate control of the interactive content by performing a specific action with the computing device 112. In some embodiments, multiple computing devices 112 can be sent notifications and / or can become associated with the interactive content. In such embodiments, the computing devices can control different portions of the interactive content and / or be placed in a queue to wait for an opportunity to control the interactive content.

[0068] At 408, process 400 may determine whether instructions have been received from computing device 112 to manipulate the interactive content. In some implementations, instructions for manipulating the interactive content may be determined by any computing device 112 based on input from one or more sensors. For example, computing device 112 may determine instructions based on translation of computing device 112 detected by one or more accelerometers (and / or any other suitable sensors that can be used to detect translation of the computing device). As another example, computing device 112 may determine instructions based on rotation of the computing device detected by one or more gyroscopes (and / or any other suitable sensors that can be used to detect rotation of the computing device). As another example, computing device 112 may determine instructions based on input received via a touchscreen of computing device 112. As yet another example, computing device 112 may determine instructions based on output from an image sensor that can be used to sense relative motion (e.g., calculate motion vectors between consecutive images). As another example, computing device 112 may determine instructions based on output from a sensor that senses the position and / or configuration of a user's hand on a particular portion of computing device 112, without requiring the user to touch the touchscreen of computing device 112.

[0069] In some embodiments, process 400 may receive an indication of whether computing device 112 associated with the media receiving device is capable of providing instructions for manipulating interactive content (e.g., whether computing device 112 has suitable sensors to detect movement of user device 112 and / or touch input by the user). Additionally or alternatively, in some embodiments, process 400 may receive an indication of whether computing device 112 is in an easily accessible state. For example, computing device 112 may send a signal indicating that computing device 112 is not easily accessible based on any suitable signal received by hardware processor 312. In a more specific example, a proximity sensor and / or light sensor of computing device 112 may indicate that the front surface of computing device 112 is blocked (e.g., because it is facing down on a table, in a user's pocket, in a user's bag, etc.).

[0070] In some implementations, process 400 may determine whether to send a notification based on the capabilities of the associated computing device 112 and / or the state of computing device 112. For example, if process 400 determines that the computing device is not readily accessible (e.g., because it may be in a user's pocket or face down on a table), then process 400 may determine that a notification is not to be sent and / or that the interactive content is not appropriate for presentation.

[0071] In some embodiments, computing device 112 may begin sending instructions to manipulate interactive content after detecting an appropriate sensor input or sensor output combination. For example, computing device 112 may begin sending instructions to manipulate interactive content after receiving a notification and sensing movement. As another example, computing device 112 may begin sending instructions to manipulate interactive content after receiving a notification and sensing a specific combination of movements. In a more specific example, the notification may instruct the user to perform a specific action, such as a specific movement of computing device 112, a specific combination of movements of computing device 112, a specific user input to the computing device's touchscreen, or the like. In such an example, after performing such an action or combination of actions, the computing device may interpret other sensor outputs to generate instructions for manipulating the interactive content. In some embodiments, computing device 112 may maintain a locked state while receiving sensor outputs, interpreting the sensor outputs, generating instructions for manipulating the interactive content, and sending the instructions to a device (e.g., a server generating the interactive content, a media receiving device receiving the interactive content, etc.).

[0072] In some implementations, computing device 112 may begin sending instructions to manipulate interactive content after a particular application is opened, such as an application used to cause the content requested at 402 to be requested or an application used to control the operation of a media receiving device.

[0073] In some embodiments, computing device 112 and / or interactive content may instruct the user to perform certain actions to calibrate and / or provide a reference point for the computing device. For example, the user may be instructed to pick up computing device 112 (or if the user is already holding computing device 112, move computing device 112) and hold computing device 112 relatively still in a comfortable center position for a specific period of time (e.g., one-half second, one second, etc.). Computing device 112 may set this point as a reference point and provide instructions to manipulate the interactive content based on acceleration and / or rotation relative to this center position. As another example, the user may be instructed to move computing device 112 in some specific sequence of actions to calibrate and / or center the computing device, such as shaking the computing device left and right, back and forth, moving the computing device in a figure 8 pattern, any other suitable sequence, or any suitable combination thereof.

[0074] In some implementations, after computing device 112 begins generating instructions for manipulating interactive content, computing device 112 may send the instructions to a media receiving device (e.g., media streaming device 102, digital media receiver 152, etc.) and / or a server generating the interactive content (e.g., content delivery server 120).

[0075] If process 400 determines that one or more instructions for manipulating the interactive content have not been received ("No" at 408), process 400 can return to 408 and continue waiting for instructions. Otherwise, if process 400 determines that one or more instructions for manipulating the interactive content have been received ("Yes" at 408), process 400 can continue to 410.

[0076] At 410, process 400 may cause the interactive content to be updated based on the instructions received from computing device 112. In some implementations, the interactive content may be updated using any suitable technique or combination of techniques. For example, an object depicted in the interactive content may be updated so that it appears that the object has been rotated based on an instruction to rotate the object.

[0077] In some implementations, the interactive content can be updated at the server before being transmitted as a video stream to the media receiving device (e.g., media streaming device 102, digital media receiver 152, etc.) from which the content was requested at 402. In such implementations, the instructions generated by computing device 112 can be received by the server (e.g., from computing device 112, relayed by media streaming device 102, relayed by digital media receiver 152, etc.).

[0078] In some embodiments, at least a portion of the interactive content can be updated at a media receiving device (e.g., a media streaming device 102, a digital media receiver 152, etc.). In such embodiments, the interactive content can be transmitted to the media receiving device as content (e.g., such as an object, a model, etc.), which is then used to generate the interactive content at the media receiving device. In such embodiments, the instructions generated by the computing device 112 can be received by the media receiving device directly (e.g., via Bluetooth) or indirectly (e.g., via a local area network, the Internet, etc.). In some embodiments, the interactive content can generally be updated by the content delivery server 120, but if there is a significant delay in communication between the computing device 112 and the content delivery server 120, the update of the interactive content can be performed by the media receiving device. In some embodiments, the amount of interaction allowed can be reduced while the media receiving device is updating the interactive content.

[0079] At 412, process 400 can cause the interactive content of updating to be presented by media receiving device.In some embodiments, as described above about 410, the interactive content of updating can be streamed from server (e.g., content delivery server 120) to media receiving device as the video to be played back by media receiving device. Media receiving device can present the interactive content of updating (e.g., using the display of media playback device 106) after receiving the interactive content of updating. Additionally or alternatively, in some embodiments, media receiving device can generate the interactive content of updating. In such an embodiment, media receiving device can present the interactive content of updating (e.g., using the display of media playback device 106) when the interactive content of updating generates.

[0080] At 414, process 400 may determine whether a request for additional information regarding the interactive content currently being presented has been received from computing device 112. In some embodiments, the user may request additional information and / or may request to perform some action regarding the interactive content. For example, if the interactive content is an advertisement related to a particular product or products, the user may provide user input to computing device 112 requesting that it navigate to a user interface for purchasing the products. In some embodiments, the request for more information may be sent in response to any suitable input from the user. For example, the user may open an application associated with the content requested at 402 and / or an application for controlling a media receiving device and select a user interface element presented by the application. In such examples, the user may open the application using any suitable technique or combination of techniques, such as by navigating to and / or launching the application via the operating system of computing device 112, by performing an action to open the application in response to a notification sent at 406, etc. As another example, the user may provide voice input to a digital assistant provided by computing device 112 indicating that the user desires more information about the interactive content.

[0081] If the process 400 determines that a request for more information has not been received ("No" at 414), the process 400 can return to 408 to wait for instructions. Otherwise, if the process 400 determines that a request for more information has not been received ("Yes" at 414), the process 400 can continue to 416.

[0082] At 416, when a request for more information is received, process 400 can cause computing device 112 to present additional information related to the interactive content being presented. In some embodiments, process 400 can cause computing device 112 to present the additional information using any suitable technique or combination of techniques. For example, when a user causes an application to be opened, process 400 can cause a link and / or user interface element for additional information to be presented in the user interface of the application, such that selection of the link and / or user interface element causes a request for the additional information from a specific address. As another example, when a user requests additional information, process 400 can cause a notification to be sent to computing device 112, such that selection of the notification causes the computing device to request the additional information.

[0083] In some embodiments, the additional information may be presented using any suitable technique or combination of techniques. For example, the additional information may be presented as a web page in a web browser or other suitable application. As another example, the additional information may be presented in an application associated with the interactive content. As another example, if the interactive content is an advertisement for a product available through an application installed on computing device 112, process 400 may cause the application to be launched. As another example, if the interactive content is associated with an application not installed on the computing device, process 400 may cause computing device 112 to present a user interface for installing the application.

[0084] Figure 5A An example 500 of information flow between a computing device 112, a media streaming device 102, and a content delivery server 120 is shown in accordance with some implementations of the disclosed subject matter. Figure 5A As shown in , at 502, the computing device 112 may send a request to the media streaming device 102 for the media streaming device 102 to present one or more media content items. Figure 4 As described in 402, the request may include identification information of the source of the content (e.g., a web address associated with the source, identification information of an application associated with the source, etc.) and identification information of the content to be presented (e.g., a character sequence associated with the content item). In some embodiments, the identification information for the source and the identification information for the content may be combined into, for example, a URL.

[0085] At 504 , the media streaming device 102 may send a request for one or more media content items to a source (eg, the content delivery server 120 ) based on the identification information sent from the computing device 112 at 502 .

[0086] At 506, the content delivery server 120 may cause the requested content and / or interactive content to be presented via the media streaming device 102 based on the request sent at 504. Figure 4 As described in 404 , the interactive content may be an advertisement not explicitly requested by the media streaming device 102 and / or may be content associated with the requested content (eg, as supplemental content).

[0087] At 508, the media streaming device 102 may present the received media content item and / or interactive content using, for example, the display 108 of the media playback device 106. Figure 4 As described above at 404, in some embodiments, the content delivery server 120 can generate interactive content and send a video stream to the media streaming device 102, which can present the video at 508. Alternatively, as described above with respect to Figure 4As described in 404 , the content delivery server 120 may send elements that may be used by the media streaming device 102 to generate interactive content.

[0088] At 510, the content delivery server 120 may cause a notification to be sent to the computing device 112 indicating that the content being presented by the media streaming device 102 is interactive content. In some implementations, the notification may be sent using a server different from the content delivery server 120 (e.g., as part of a push notification system associated with the operating system of the computing device 112 and / or applications installed on the computing device 112). In some implementations, the notification may be sent at 510 using any suitable technique or combination of techniques, such as those described above with respect to Figure 4 The technique described in 406.

[0089] At 512, computing device 112 may send instructions for controlling the interactive content to content delivery server 120. In some implementations, the instructions may be generated using any suitable technique or combination of techniques, such as those described above with respect to Figure 4 The technique described in 408.

[0090] At 514, the content delivery server 120 may update the interactive content based on the instructions received from the computing device 112 to control the presentation of the interactive content. In some implementations, the content delivery server 120 may use any suitable graphics presentation technique or combination of techniques to update the interactive content based on the instructions provided from the computing device 112. For example, the content delivery server 120 may update the interactive content so that objects presented within the interactive content appear to rotate in response to an instruction from the computing device 112 to rotate the interactive content. As another example, the content delivery server 120 may update the interactive content so that a series of objects appear to move on the display 108 of the media playback device 106 in response to an instruction from the computing device 112 to scroll the series of objects in the interactive content (e.g., based on a lateral translation of the computing device 112). As another example, the content delivery server 120 may update the interactive content so that the interactive content appears larger (i.e., by performing a zoom operation) in response to an instruction from the computing device 112 to zoom in on the interactive content (e.g., based on a translation of the computing device 112 in a direction assumed to be toward the user). As another example, the content delivery server 120 may update the interactive content such that the interactive content is moved to a corner of the video stream (e.g., as an overlay of the requested content item) such that the interactive content appears in a corner of the display 108 of the media playback device 106 in response to the computing device 112 giving an instruction to shrink the interactive content (e.g., based on receiving a touch at a corresponding corner of the touch screen of the computing device 112).

[0091] At 516, the content delivery server 120 may cause the updated interactive content to be presented by the media streaming device 102. The updated interactive content may be sent as part of a video stream depicting the interactive content as described above with respect to 508. At 518, the media streaming device 102 may present the updated interactive content.

[0092] At 520, the computing device 112 may request additional information about the interactive content currently being presented by the media streaming device 102, and at 522, the content delivery server 120 may cause the computing device 112 to present content related to the interactive content and the additional information about the interactive content. In some implementations, the computing device 112 may initiate the request for additional information using any suitable technique or combination of techniques, such as described above with respect to Figure 4 In some embodiments, the content delivery server 120 (and / or any other suitable server) may cause the computing device 112 to present the additional information using any suitable technique or combination of techniques, such as described above with respect to Figure 4 The technology described in 416.

[0093] Figure 5B An example 550 of information flow between computing device 112, media streaming device 102, and content delivery server 120 is shown in accordance with some implementations of the disclosed subject matter. Figure 5B As shown in , at 552, computing device 112 may be associated with digital media receiver 152. In some implementations, computing device 112 and digital media receiver 152 may be associated using any suitable technique or combination of techniques. For example, computing device 112 and digital media receiver 152 may be associated based on the user interface being used to control digital media receiver 152 (e.g., as described above with respect to FIG. Figure 4 As another example, computing device 112 and digital media receiver 152 may be associated based on a user of computing device 112 initiating a connection with digital media receiver 152 (e.g., over a local area network, using a short-range wireless communication protocol, etc.). As another example, computing device 112 and digital media receiver 152 may be associated based on the same user account being logged into the same application associated with a service from which content is being requested (e.g., as described below with respect to 554) on both computing device 112 and digital media receiver 152—with both devices connected to the same local area network.

[0094] At 554, the digital media receiver 152 may send a request for one or more media content items to the content delivery server 120. In some implementations, any suitable technique or combination of techniques may be used to initiate the request for one or more media content items, such as described above with respect to Figure 1B and Figure 4 The 402 described technique.

[0095] At 556, the content delivery server 120 may cause the requested content and / or interactive content to be presented by the digital media receiver 152 based on the request sent at 554. Figure 4 As described in 404 , the interactive content may be an advertisement that is not explicitly requested by the digital media receiver 152 and / or may be content associated with the requested content (eg, as supplemental content).

[0096] At 558, the digital media receiver 152 may present the received media content item and / or interactive content using, for example, the display 108 of the media playback device 106. Figure 4 As described at 404, in some embodiments, the content delivery server 120 can send graphical elements that can be used by the digital media receiver 152 to generate interactive content for presentation at 558. Additionally or alternatively, in some embodiments, the content delivery server 120 can generate the interactive content and send a video stream to the digital media receiver 152, which can present the video at 558.

[0097] At 560, content delivery server 120 may cause a notification to be sent to computing device 112 indicating that the content being presented by digital media receiver 152 is interactive content. In some implementations, the notification may be sent using a server different from content delivery server 120 (e.g., as part of a push notification system associated with the operating system of computing device 112 and / or applications installed on computing device 112). In some implementations, the notification may be sent at 560 using any suitable technique or combination of techniques, such as those described above with respect to Figure 4 Additionally or alternatively, in some implementations, at 562 the digital media receiver 152 may cause a notification to be sent to the computing device 112 .

[0098] At 564, computing device 112 may send instructions for controlling the interactive content to digital media receiver 152 and / or content delivery server 120. In some implementations, the instructions may be generated using any suitable technique or combination of techniques, such as those described above with respect to Figure 4 The technique described in 408.

[0099] At 566, the digital media receiver 152 may update the interactive content based on the instructions received from the computing device 112 to control the presentation of the interactive content. In some implementations, the digital media receiver 152 may use any suitable graphics rendering technology or combination of technologies to update the interactive content based on the instructions provided from the computing device 112, such as those described above with respect to Figure 5A Additionally or alternatively, at 568, content delivery server 120 may update the interactive content based on instructions received from computing device 112 to control the presentation of the interactive content.

[0100] At 570, in some implementations where the interactive content is updated by the content delivery server 120, the content delivery server 120 may cause the updated interactive content to be presented by the digital media receiver 152. As described above with respect to 508, the updated interactive content may be sent as part of a video stream depicting the interactive content. At 572, the digital media receiver 152 may present the updated interactive content generated by the digital media receiver 152 and / or received from the content delivery server 120.

[0101] although Figure 5B Not shown, but in some embodiments, computing device 112 may use Figure 5B Similar techniques as described at 520 and 522 may be used to request, receive, and / or present additional information about the interactive content being presented at 572. However, in some implementations, the request for additional information may be received by the digital media receiver 152.

[0102] In some embodiments, the mechanisms described herein may include server-side software, server-side hardware, client-side software, client-side hardware, or any suitable combination thereof. For example, the mechanisms may include a computer program written in a programming language that can be recognized by hardware processor 312, hardware processor 322, and / or hardware processor 332 (e.g., a program written in a programming language such as Java, C, Objective-C, C++, C#, Javascript, Visual Basic, or any other suitable approach). As another example, an application may include code corresponding to one or more web pages or portions of web pages (e.g., via any suitable encoding, such as Hypertext Markup Language ("HTML"), Dynamic Hypertext Markup Language ("DHTML"), Extensible Markup Language ("XML"), JavaServer Pages ("JSP"), Active Server Pages ("ASP"), Cold Fusion, or any other suitable approach).

[0103] In some embodiments, any suitable computer-readable medium may be used to store instructions for performing the functions and / or processes described herein. For example, in some embodiments, the computer-readable medium may be temporary or non-temporary. For example, the non-temporary computer-readable medium may include media such as magnetic media (such as hard disks, floppy disks, etc.), optical media (such as compact discs, digital video discs, Blu-ray discs, etc.), semiconductor media (such as flash memory, electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), etc.), any suitable medium that is not fleeting or lacks any permanence during transmission, and / or any suitable tangible medium. As another example, the temporary computer-readable medium may include a signal on a network, a wire, a conductor, an optical fiber, a circuit, any suitable medium that is fleeting and lacks any permanence during transmission, and / or any suitable intangible medium.

[0104] It should be understood that Figure 4 、 Figure 5A and Figure 5B The above steps of the process may be performed in any order or sequence, not limited to the order and sequence shown and described in the accompanying drawings. Figure 4 、 Figure 5A and Figure 5B Some of the above steps of the process may be performed substantially simultaneously, or in parallel, where appropriate, to reduce latency and processing time.

[0105] It should also be noted that, as used herein, the term mechanism may encompass hardware, software, firmware, or any suitable combination thereof.

[0106] Thus, provided herein are systems, methods, and media for interacting with content using a second screen device.

[0107] Although the present invention has been described and illustrated in the foregoing illustrative embodiments, it should be understood that this disclosure is by way of example only and that many changes may be made to the details of the embodiments without departing from the spirit and scope of the invention, which is limited only by the appended claims. The features of the disclosed embodiments may be combined and rearranged in various ways.

Claims

1. A method for interacting with content using a second screen device, the method comprising: receiving a stream of a video content item using a media device, wherein the media device is connected to a mobile device; detecting that a video content item in the stream of video content items includes interactive content, wherein the interactive content presented on a display device connected to the media device is controllable by receiving user input from the mobile device; determining whether the mobile device is capable of providing instructions for controlling the interactive content presented on a display device connected to the media device; and In response to determining that the mobile device is capable of providing the instructions for controlling the interactive content presented on the display device connected to the media device, while causing the video content item containing the interactive content to be presented, a notification is transmitted to the mobile device, wherein the notification indicates that the video content item contains interactive content that is controllable by providing one or more user inputs to the mobile device.

2. The method according to claim 1, wherein The instructions include instructions to manipulate an object.

3. The method according to claim 1, wherein The interactive content is advertising content that does not correspond to the video content item in the stream of video content items.

4. The method according to claim 1, further comprising: receiving instructions from the mobile device based on the one or more user inputs to control how objects depicted in the interactive content are presented; In response to receiving the instruction, updating the interactive content including the object based on the one or more user inputs; and The updated interactive content in the update stream of the video content item is caused to be presented.

5. The method of claim 4, further comprising receiving the update stream of the video content item from a server, wherein The update stream of the video content item includes updated interactive content.

6. The method of claim 1 , further comprising receiving a request from an application installed on the mobile device to present a stream of the video content item, wherein The notification is associated with the application.

7. A system for interacting with content using a second screen device, the system comprising: A media device, wherein the media device: receiving a stream of a video content item, wherein the media device is connected to a mobile device; detecting that a video content item in the stream of video content items includes interactive content, wherein the interactive content presented on a display device connected to the media device is controllable by receiving user input from the mobile device; determining whether the mobile device is capable of providing instructions for controlling the interactive content presented on a display device connected to the media device; and In response to determining that the mobile device is capable of providing the instructions for controlling the interactive content presented on the display device connected to the media device, while causing the video content item containing the interactive content to be presented, a notification is transmitted to the mobile device, wherein the notification indicates that the video content item contains interactive content that is controllable by providing one or more user inputs to the mobile device.

8. The system according to claim 7, wherein: The instructions include instructions to manipulate an object.

9. The system according to claim 7, wherein: The interactive content is advertising content that does not correspond to the video content item in the stream of video content items.

10. The system according to claim 7, wherein: The media device also: receiving instructions from the mobile device based on the one or more user inputs to control how objects depicted in the interactive content are presented; In response to receiving the instruction, updating the interactive content including the object based on the one or more user inputs; and The updated interactive content in the update stream of the video content item is caused to be presented.

11. The system according to claim 10, wherein: The media device also receives the update stream of the video content item from a server, wherein the update stream of the video content item includes the updated interactive content.

12. The system according to claim 7, wherein: The media device also receives a request from an application installed on the mobile device to present a stream of the video content item, wherein the notification is associated with the application.

13. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for interacting with content using a second screen device, the method comprising: receiving a stream of a video content item using a media device, wherein the media device is connected to a mobile device; detecting that a video content item in the stream of video content items includes interactive content, wherein the interactive content presented on a display device connected to the media device is controllable by receiving user input from the mobile device; determining whether the mobile device is capable of providing instructions for controlling the interactive content presented on a display device connected to the media device; and In response to determining that the mobile device is capable of providing instructions for controlling the interactive content presented on a display device connected to the media device, while causing the video content item containing the interactive content to be presented, a notification is transmitted to the mobile device, wherein the notification indicates that the video content item contains interactive content that is controllable by providing one or more user inputs to the mobile device.

14. The non-transitory computer-readable medium of claim 13, wherein: The instructions for controlling the interactive content presented on a display device connected to the media device include instructions for manipulating an object.

15. The non-transitory computer-readable medium of claim 13, wherein: The interactive content is advertising content that does not correspond to the video content item in the stream of video content items.

16. The non-transitory computer-readable medium of claim 13, wherein: The method further comprises: receiving instructions from the mobile device based on the one or more user inputs to control how objects depicted in the interactive content are presented; In response to instructions received from the mobile device, updating the interactive content including the object based on the one or more user inputs; and The updated interactive content in the update stream of the video content item is caused to be presented.

17. The non-transitory computer-readable medium of claim 16, wherein: The method also includes receiving the update stream of the video content item from a server, wherein the update stream of the video content item includes the updated interactive content.

18. The non-transitory computer-readable medium of claim 13, wherein: The method also includes receiving a request from an application installed on the mobile device to present a stream of the video content item, wherein the notification is associated with the application.

Images