Monitoring of display devices

Abstract

A monitoring apparatus for monitoring a state of a display device, the monitoring apparatus comprising: an infrared (IR) receiver for detecting an IR signal transmitted from a remote controller; a processor configured to determine operation instructions for operating the display device from the IR signal, where the operation instructions include a channel change instruction and / or a power instruction; and a memory configured to store a current state of the display device, the current state including a channel and / or power state displayed on the display device; wherein the processor is configured to determine an updated state of the display device based at least in part on the operational instructions, and replace the current state stored in the memory with the updated state.

Description

Technical Field

[0001] The present disclosure relates to systems and methods for monitoring a display device and determining viewer information associated with the display device.

[0002] Related technical description

[0003] Monitoring equipment can be used to monitor a display device, such as a television. The monitoring equipment can, for example, record the content being viewed on the display device and / or information related to audience members viewing the display device. The collected information can be transmitted to a remote system where it can be compared with information related to other display devices. Such monitoring equipment and / or remote system can be part of a Television Audience Measurement System (TAMS).

[0004] Traditionally, TAMS monitoring required viewers to manually record what they watched in a diary. With the advent of smartphones, viewers have been able to enter information about themselves and the content they watched into an app on their smartphone, which can then transmit the data directly to TAMS. However, such methods may require users to remember to enter information and assume that the information has been entered correctly. Therefore, automating data capture may be preferable, but such methods may limit how viewers can interact with the display device. For example, viewers may be required to use a dedicated TAMS remote control or a monitoring app on their smartphone to control the display device. Consequently, conventional TAMS methods tend to either produce inaccurate data or overly restrict viewers, potentially leading to a lack of interaction with the audience monitoring system. Some conventional TAMS systems employ monitoring devices installed in viewers' homes that record audio. The intention is to record the audio played by the television so that the content being viewed can be inferred from the recorded audio. However, such devices may also record other sounds around them, raising privacy concerns. Furthermore, transmitting large audio files to a remote server can tax network resources, and processing the audio files to compare them with known content is computationally intensive.

[0005] Therefore, a need exists for systems and methods that can overcome one or more of the challenges identified above. Summary of the Invention

[0006] According to a first aspect, a monitoring device for monitoring the status of a display device is provided, the monitoring device comprising: an infrared (IR) receiver for detecting an IR signal transmitted from a remote controller; a processor configured to determine an operating instruction for operating the display device from the IR signal, wherein the operating instruction comprises a channel change instruction and / or a power instruction; and a memory configured to store a current status of the display device, wherein the current status comprises a channel and / or a power status displayed on the display device; wherein the processor is configured to determine an updated status of the display device based at least in part on the operating instruction, and replace the current status stored in the memory with the updated status.

[0007] Such a monitoring device can allow viewers to operate the display device using a conventional remote control (such as one associated with or provided with the display device). Thus, viewers can operate the display device as if they were not using the monitoring device, rather than having to enter viewing information into a diary. The monitoring device can be considered to maintain a "digital twin" of the display device, reflecting changes to the display device to maintain the current state of the display device. This current state can then be used by, for example, a TAMS to determine what content is being viewed on the display device. This process does not require audio recording, improving privacy compared to conventional systems. Furthermore, by storing the current state of the display device, relative changes to the display device, such as channel up / down or power on / off commands, can be captured, allowing the viewer to use the relative change buttons on the remote control as usual. In contrast, conventional monitoring systems may require providing a specific channel or power state. Furthermore, the monitoring device can be used with conventional, non-smart televisions (TVs). Non-smart TVs cannot communicate with TAMS or with apps running on the viewer's smartphone, and therefore conventionally require viewers to maintain a manual diary to record viewing information.

[0008] In some examples, the processor may be configured to determine the updated state of the display based at least in part on the operating instruction and the current state stored in the memory. In some such examples, the operating instruction may include a channel change instruction. The channel change instruction may include a channel up instruction or a channel down instruction. The processor may be configured to determine the updated channel displayed on the display device based at least in part on the current state stored in the memory and the channel up instruction or the channel down instruction. The updated channel may then be stored as the updated state, or as part of the updated state. Such examples may allow specific viewing information to be extracted from relative change input commands, such as channel up / down, power on / off, or volume up / down / mute commands entered by the viewer on the remote control.

[0009] In some examples, the processor can be configured to perform an initialization operation to initialize the current state stored in the memory. The initialization operation can include receiving an initialization signal from a user device, such as a portable electronic device (e.g., a smartphone or tablet). The initialization signal can include information specifying a channel for display on the display device and / or information specifying a power state of the display device. The initialization operation can also include determining an initial state of the display device based at least in part on the initialization signal. The initial state can include a channel currently displayed on the display device and / or a current power state. The initial state can be stored in the memory as the current state discussed above. Such an example can provide the monitoring device with initial information specifying an individual displayed channel or power state of the display device. Subsequently, the monitoring device can detect a relative change input, such as a channel up / down command as discussed above.

[0010] In some examples, the display device may be controllable by both an IR remote control and a user device, for example, via an application running on a smartphone. Such examples may provide users with flexibility in how they control the display device. The monitoring device may also be configured to receive signals from the user device, for example, via a radio wave receiver. Advantageously, in some examples, the user device / application may at least temporarily provide only specific channel / power state input options, rather than relative change input options. Thus, when the viewer uses the user device to control the display device, specific channel / power information may be provided, which may be used as the initialization signal for the initialization operation. Thus, the combination of the monitoring device, remote control, and user device may provide a flexible and robust system for capturing viewing information.

[0011] According to a second aspect, a computer-implemented method for monitoring the status of a display device is provided, the method comprising: receiving an infrared (IR) signal transmitted from a remote control to the display device at a monitoring device separate from the display device; determining an operating instruction for operating the display device from the IR signal, wherein the operating instruction comprises a channel change instruction and / or a power instruction; determining a current status of the display device based at least in part on the operating instruction, the current status comprising a channel and / or power status displayed on the display device; and storing the current status of the display device in a memory.

[0012] According to a third aspect, there is provided a computer program comprising instructions which, when executed by a computer, cause the computer to perform the method according to any of the embodiments of the second aspect.

[0013] According to a fourth aspect, there is provided a computer readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method according to any embodiment of the second aspect.

[0014] According to a fifth aspect, a computer-implemented method for verifying viewer information associated with a display device in an audience measurement system is provided, wherein the audience measurement system is used to monitor viewers of broadcast media, and wherein the method includes: receiving initial viewer information by the audience measurement system, the initial viewer information identifying a first user as viewing the display device; capturing, by a monitoring device of the audience measurement system associated with the display device, a wireless signal transmitted between a user device and an external system (for example, transmitted by the user device and directed to the external system, or transmitted by the external system and directed to the user device); and verifying, by the audience measurement system, the initial viewer information based at least in part on the wireless signal.

[0015] Such methods may provide an automated process for verifying viewer information input (or otherwise derived) by a viewer. The viewer information may specify one or more viewers of the display device and may specify information associated with content viewed on the display device. In contrast, conventional audience measurement systems may rely entirely on information input by viewers, which may be prone to error. Thus, the method of the fifth aspect may improve the accuracy of data collected by the audience measurement system. The method of the fifth aspect may automatically verify information by "sniffing" signals that are not directed to the audience measurement system / monitoring device. Thus, these methods may automatically and passively verify viewer information without the active participation of the viewer, viewer device (e.g., smartphone), and / or the display device. Thus, these methods may provide a simple (e.g., not burdensome for the viewer) and accurate audience measurement system.

[0016] In some examples, the initial viewer information can be generated based on information directed to the audience measurement system. For example, the viewer information can be generated based on viewer input, information received from a viewer device, and / or information received from a remote server. Thus, the initial generation of viewer information and the verification of the viewer information can use different processes, improving the accuracy of the collected information.

[0017] In some examples, the user device may be associated with the first user. In such examples, verifying the initial viewer information may include determining, by the audience measurement system and at least in part based on the wireless signal, that the first user is not viewing the display device. Thus, verifying the initial viewer information may include determining that the initial viewer information is incorrect. The first user may then be removed from the initial viewer information, i.e., the original information may be corrected. Such examples may provide automated correction of user-entered information such that the monitoring system treats the first user as not viewing the display device at all (at least in the current session). This may provide more accurate viewer information to the audience measurement system.

[0018] In some examples, determining that the first user is not viewing the display device may include determining that the user device is outside of a viewing zone associated with the display device based in part on a strength (e.g., a signal-to-noise ratio) of the wireless signal.

[0019] Alternatively or in addition, determining that the first user is not viewing the display device may include determining, by the audience measurement system, that the wireless signal is associated with streaming media displayed on the user device. For example, a header and / or payload of a data packet of the wireless signal may be read to determine whether the packet is associated with streaming media and whether it was transmitted or directed to the user device by the user device of the first user. If the user device is displaying streaming media, it may be determined that the first user is not actually viewing the display device. This may provide automated correction of viewer information, for example where the first user's position indicates that they are viewing the display device (e.g., they are in the viewing zone), or where the first user or another user has input the first user as viewing the display device, even if the first user is not actually interacting with content on the display device.

[0020] In some examples, the user device may be associated with a second user that is not identified in the initial viewer information. Verifying the initial audience information may include determining, by the audience measurement system and based at least in part on the wireless signal, that the second user is viewing the display device. Thus, the method may automatically add additional viewers to the initial viewer information and remove incorrectly identified viewers.

[0021] According to the sixth aspect, a monitoring device for monitoring a display device is provided, the monitoring device comprising: a wireless signal receiver for detecting a wireless signal transmitted by a user device; one or more processors; and one or more computer-readable media storing instructions, which, when executed, enable the monitoring device to perform a method according to any embodiment of the fifth aspect.

[0022] According to a seventh aspect, there is provided an audience measurement system comprising a monitoring device according to any embodiment of the sixth aspect.

[0023] According to an eighth aspect, there is provided an audience measurement system comprising: one or more processors; and one or more computer-readable media storing instructions which, when executed, cause a monitoring device to perform a method according to any embodiment of the fifth aspect.

[0024] According to a ninth aspect, there is provided a computer program comprising instructions which, when executed by a computer, cause the computer to perform the method according to any embodiment of the fifth aspect.

[0025] According to a tenth aspect, there is provided a computer readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method according to any embodiment of the fifth aspect.

[0026] Further features and advantages will become apparent from the following description of embodiments, which is given by way of example only with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 An exemplary monitoring apparatus for monitoring a display device is shown.

[0028] Figure 2 An exemplary method of maintaining a current state of a display device in a monitoring apparatus is shown.

[0029] Figure 3 An exemplary method for initializing a current state stored in a monitoring device is shown.

[0030] Figure 4 An exemplary audience measurement system for verifying viewer information associated with a display device is shown.

[0031] Figure 5 An exemplary method of verifying viewer information is shown.

[0032] Figure 6a and Figure 6b A process of detecting whether a user is within a viewing area of ​​a display device to verify viewer information is shown. DETAILED DESCRIPTION

[0033] It should be understood that the teachings set forth herein are intended to be exemplary only and not limiting. The concepts herein are not limited to use or application with respect to any particular system or method for monitoring or determining viewer information on a display device. Therefore, while the means described herein are for ease of explanation with respect to the exemplary embodiments shown and described, it should be understood and appreciated that the principles herein can be equally applied to other types of systems and methods for monitoring or determining viewer information on a display device.

[0034] Monitoring equipment

[0035] Figure 1 An exemplary monitoring device 100 is shown for monitoring a display apparatus 200. The display apparatus may be controlled by a remote controller 300.

[0036] The monitoring device 100 can be an audience measurement system such as a Television Audience Measurement System (TAMS), or can be part of an audience measurement system. The monitoring device 100 can be co-located with the display device 200. For example, the monitoring device can be in the same building or room as the display device 200, or can be located adjacent to the display device. The monitoring device can be a standalone device separate from the display device 100. In some examples, the monitoring device 100 can be incorporated into a component associated with the display device 200, such as a set-top box.

[0037] The display device 200 may be or include a television (TV), a non-smart TV, a smart TV, a set-top box, or a streaming device. The display device 200 may be used to display media, such as broadcast media. The display device 200 may include an antenna connection, a network connection, or any other component for receiving media from a remote source.

[0038] The remote control 300 can transmit signals for controlling the display device 200 based on input from the user (e.g., the user pressing buttons on the remote control 300). Although presented here as the same physical buttons as in a conventional remote control, in other examples, the remote control 300 can include a display with a graphical user interface (GUI) showing selectable GUI elements representing buttons or any other user input means.

[0039] The remote controller 300 can directly control the display device, i.e., it does not require an intermediate component to receive signals to control the TV. The remote controller 300 can be associated with the display device 200, for example, the remote controller 300 can be provided together with the display device 200, and / or can be designed specifically for use with the display device 200. The remote controller 300 can have the sole function of controlling the display device 200 or a similar display device.

[0040] The remote control 300 may be an infrared (IR) remote control. Specifically, the remote control 300 may include an IR transmitter 304 configured to transmit an IR signal 302 for controlling the display device. The display device 200 may include an IR receiver 202 for receiving the IR signal 302. The IR signal 302 may encode an operating instruction based on user input, and the display device 302 is configured to extract the operating instruction. The operating instruction may be, for example, a channel change instruction for changing the channel displayed on the display device 200. For example, the user may have selected a specific channel button (e.g., a numbered button in the illustrated example) or a channel change button (such as the channel up button 306 or the channel down button 308). The channel up button 306 / channel down button 308 may be intended to increase the channel number by 1 (or any other number). The operating instruction may be a power instruction for changing the power state of the display device 200. For example, the power instruction may control the display device 200 to turn on or off, or enter or exit standby mode. The user may have selected the power toggle button 310 to switch the display device 200 from on to off, or vice versa. The operating instruction may be a volume instruction for changing the volume of audio emitted by the display device 200 and / or one or more speakers associated with the display device 200. For example, the volume instruction may increase or decrease the volume level, or turn a mute setting on or off. The user may have selected a corresponding volume button on the remote control 300. Additional operating instructions may turn subtitles on or off, or select an audio mode.

[0041] like Figure 1 As shown, IR signal 302 from remote control 300 can also be received by monitoring device 100. Monitoring device 100 includes IR receiver 102 for detecting IR signal 302. For example, IR receiver 102 can be or include a photodiode or phototransistor for converting IR signal 302 into an electrical signal. In some examples, both display device 200 and monitoring device 100 can independently receive IR signal 302. In other examples, monitoring device 100 can be positioned to intercept IR signal 302, preventing it from reaching display device 200. In such cases, monitoring device 100 can relay the IR signal, or any other signal type, to display device 200 to control it.

[0042] The monitoring device 100 includes a processor 104. The processor 104 can receive an IR signal 302, or a representation of the IR signal 302, from the IR receiver 102. The processor 104 is configured to determine an operating instruction for operating the display device from the IR signal 302. In other words, the processor 104 can extract the operating instruction encoded in the IR signal 302 similarly to how the display device 200 interprets the IR signal 302. In a specific example, the IR signal 302 can include a signal code representing the operating instruction. The processor 104 can be configured to determine the operating instruction from the IR signal 302 by comparing the signal code to a plurality of stored codes, each stored code being associated with a corresponding known operating instruction.

[0043] A matching code can be identified from a plurality of stored codes (e.g., stored in memory 106, as discussed below) based on similarities between the signal code and the stored codes. Known operating instructions associated with the matching code can be identified as operating instructions for the IR signal. In some examples, the set of signal codes may be specific to the manufacturer or model of the display device 200. Thus, the processor 104 may compare the signal code to a wide range of stored codes to identify a matching code. However, this process can be computationally expensive and may not be accurate in situations where multiple manufacturers use similar codes. Advantageously, however, some examples of the monitoring device 100 may be capable of receiving a signal from a user's computer device, such as a smartphone. In such examples, the user may be able to select the manufacturer and / or model of the display device 200 via an application on their device and transmit this information to the monitoring device 100. The processor 104 may then only need to search for known codes associated with the manufacturer and / or model entered by the user.

[0044] The processor 104 may be or include a microprocessor, a general-purpose processor, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a field-programmable gate array (FPGA) or other programmable logic device, discrete hardware components, discrete gate or transistor logic, or any suitable combination thereof capable of performing the functions described herein. The processor 104 may also be implemented as a combination of computing devices, such as, for example, multiple microprocessors, a combination of a DSP and a microprocessor, one or more microprocessors combined with a DSP core, or other such configurations.

[0045] The monitoring device 100 also includes a memory 106, or is communicatively coupled to a memory device. The memory 106 is configured to store a current state 108 of the display device. The current state 108 can be or include a channel displayed on the display device, a power state (i.e., on or off), a volume state (e.g., volume setting, volume up, volume down, mute on, mute off), an audio mode state (e.g., surround sound), and / or a subtitle state (i.e., subtitles on or off, and / or the language of the subtitles). The current state 108 can serve as a "digital twin" of the display device 200, representing the state of the display device 200 at the current time. When the state of the display device 200 changes, the current state 108 can be updated to maintain an up-to-date representation of the state of the display device 200. As discussed further below, the current state 108 can be determined and updated based on an IR signal 302 received from the remote control 300 and, in particular, based on an operating instruction determined by the processor 104. The memory 106 can also store one or more previous states 110. The previous state 110 may be a copy of the previous current state 108 and may be stored along with an associated time or time period associated with the previous current state 108 (e.g., a time or time range when a particular channel was viewed on the display apparatus 200). The current state may include or be associated with additional information, such as information about who is viewing the display apparatus 200, computing devices that are near the display apparatus 200, etc.

[0046] The current state 108 (or previous state 110) can be used to identify media content displayed on the display device 200. For example, a channel displayed on the display device 200 (as stored under the current state 108 / previous state 110) can be associated with a time. The processor 104 can be configured to compare the channel and time with a content schedule (e.g., a lookup table) to determine what content was on the channel at that time. The content can also be stored as part of the current state 108 / previous state 110. In other examples, the content being viewed can be stored by a remote server (e.g., a server) that receives the current state 108 and / or previous state 110 from the monitoring device 100. Figure 4 Thus, compared to conventional TAMS devices, the monitoring device 100 can automatically determine the content being viewed on the display device 200 without recording the audio of the surrounding environment, eliminating the privacy concerns and computational burden associated with audio recording and processing.

[0047] In some examples, the memory 106 may also store viewer information associated with the states 108, 110 of the display device 200. For example, the current state 108 may be associated with one or more viewers determined to be currently viewing the display device 200. The viewer information may be accessed by referring to the following table with respect to the state 108, 110 of the display device 200. Figures 4 to 6bThe viewer information may be determined based on the current state 108 / previous state 110. For example, if the volume of the display device 200, as reflected in the current state 108 / previous state 110, is low (below a predetermined threshold) or muted, the monitoring device 100 may determine that no one is actually viewing the display device 200 and may therefore automatically remove one or more viewers from the viewer information. Thus, the current state 108 may be used to provide more accurate information about viewers of the display device 200.

[0048] Memory 106 may include one or more volatile memories, such as random access memory (RAM), and non-volatile memories, such as read-only memory (ROM) or a solid-state drive (SSD), such as flash memory. Memory 106 may include other storage media, such as magnetic or optical storage media, and may be in formats such as compact discs (CDs), digital versatile discs (DVDs), and the like. Memory 106 may be removable from monitoring device 100, such as an SD or USB type drive, or non-removable.

[0049] In some examples, the monitoring device 100 may also include a network interface for transmitting the current state 108 / previous state 110 of the display device 200 to a remote server over a network. The remote server may be part of an audience measurement system and may be used to collect audience measurement data (e.g., display device status, viewed content, viewer information) from multiple monitoring devices 100. The network connection may be, for example, an Ethernet interface, a wireless (e.g., Wi-Fi) interface, a cellular interface, etc.

[0050] Updates the display's current status

[0051] Figure 2 An exemplary method 400 is shown for storing the current state 108 of the display device 200 in the memory 106. The method 400 may be performed by the monitoring apparatus 100.

[0052] The method 400 includes an operation 402 at which the IR signal 302 transmitted from the remote control 300 to the display device 200 is received by the monitoring apparatus 100 , such as via the IR receiver 102 .

[0053] Method 400 includes operation 404, which includes determining operating instructions for operating display device 200 from IR signal 302. The operating instructions may include channel change instructions and / or power instructions, such as those described above with respect to the operating instructions transmitted by remote control 300. Operation 404 may be performed by processor 104, as discussed above.

[0054] Method 400 includes operation 406, which includes determining a current state of the display device (i.e., a state of the display device 200 after implementing the operating instruction encoded in the IR signal 302) based at least in part on the operating instruction. The current state may include a channel displayed on the display device and / or a power state. Operation 406 may be performed by processor 104 as discussed above.

[0055] In some cases, the IR signal 302 may encode a specific channel selection or power state. In such cases, the processor 104 may determine the current state 108 directly from the specific channel selection or power state encoded in the IR signal 302. However, in other cases, the IR signal 302 may encode a "relative change" operational instruction, such as a channel up, channel down, volume up, volume down, or power toggle instruction. In such cases, the processor 104 may determine the (new / updated) current state 108 of the display based at least in part on the operational instruction and the (previous) current state 108 stored in the memory 106. For example, the operational instruction may include a channel change instruction. The channel change instruction may include a channel up instruction or a channel down instruction. The processor 104 may be configured to determine the updated channel displayed on the display device based at least in part on the current state 108 stored in the memory 106 and the channel up instruction or the channel down instruction. For example, the processor 104 may retrieve the previous channel number and increment it by one to determine the new channel number. Similarly, if the operation instruction includes a power switch instruction, the processor 104 can determine that the new power state is the opposite of the previous state, for example, the new state 108 is "on" or the previous state is "off", and vice versa. Therefore, by maintaining the "digital twin" of the display device 200 as represented by the stored current state 108, the monitoring device 100 can capture viewing information even if the user presses a "relative change" button (such as the channel up button 306 / channel down button 308 or the power switch button 310) on the remote control 300. Therefore, the monitoring device 100 of the present disclosure can allow the user to flexibly use a traditional TV remote control as desired while capturing all viewing information, even for non-smart TVs.

[0056] The method 400 ends with operation 408, which includes storing the (new / updated) current state 108 of the display device 200 in the memory 106. Operation 408 may include replacing the (previous) current state 108 in the memory 106 with the newly determined current state 108. The (previous) current state 108 may be deleted or may be stored in the memory 106 as the previous state 110.

[0057] Receives signals from user devices and IR remote controls

[0058] Advantageously, in some examples, the monitoring device 100 may be capable of receiving signals from both the IR remote control 300 and a user device (such as a smartphone running an application for controlling the display device 200 and / or for interacting with the monitoring device 100). Such examples may provide users with additional flexibility in how they control the display device 200. To this end, in some examples, the monitoring device 100 may include a radio wave receiver 112. The radio wave receiver 112 may be used to receive radio wave signals from the user device. For example, the radio wave receiver 112 may be a Wi-Fi receiver for receiving Wi-Fi signals and / or a Bluetooth receiver for receiving Bluetooth signals.

[0059] Such signals may include operating instructions for controlling the display device 200, similar to the IR signal 302 discussed above. The processor 104 may be configured to determine the current state of the display device 200 based at least in part on the operating instructions encoded in the radio wave signal. Alternatively, the signal may encode user-entered information that specifies the state of the display device 200 but is not intended to control the display device 200.

[0060] In some examples, a wireless signal may be directed to the monitoring device 100. For example, a user device may include an application associated with an audience measurement system of which the monitoring device 100 is a part. A user may select a control (e.g., channel, volume, power control) on the application, and in response, the application may cause a radio wave signal to be transmitted. The application may be used to control the display device 200, or simply to collect information from the user about the display device 200 ("user-input information"). The monitoring device 100 may relay a signal (e.g., radio wave or IR) to the display device 200 based on the received radio wave signal. For example, a user may select a channel on their smartphone, which may be transmitted as a radio wave signal to the monitoring device 100, which may then transmit an IR signal containing appropriate operating instructions for controlling the display device 200 to the display device 200.

[0061] In some examples, the radio wave signal may be directed to the display device 200 itself, i.e., the radio wave signal may be intended to be received by the display device 200. The monitoring device 100 may capture or intercept the radio wave signal and extract the information contained therein to determine the status of the display device 200. The monitoring device 100 may then retransmit the radio wave signal or any other type of signal to the display device 200. Thus, the radio wave receiver 112 may be a wireless signal "sniffer," such as a Wi-Fi sniffer. Figures 4 to 6b Provides further details regarding the acquisition of wireless signals directed to other systems.

[0062] In some examples, the user device may be a computing device, a portable computing device, a smartphone, a tablet, a laptop, or a wearable device.

[0063] Initialize the state

[0064] Figure 3 An exemplary method 500 for initializing the current state 108 stored in the memory 106 is shown. The method 500 can be used to provide detailed information about the state of the display device 200 so that the future state can be determined from a "relative change" command (e.g., channel up / down). The method 500 has the following particular advantages: providing a monitoring device 100 that is capable of receiving both IR signals from a conventional remote control and radio wave signals from a user device; that is, providing a mechanism for capturing initialization information so that the user can use the remote control 300 in other ways as usual, including pressing the "relative change" button, without any loss of viewing information.

[0065] Method 500 includes operation 502, which includes receiving an initialization signal from a user device. The initialization signal may include information specifying the state of the display device 200. For example, the initialization signal may specify a channel to be displayed (or currently displayed) on the display device 200 and / or specify information about the power state of the display device.

[0066] Although referred to herein as an "initialization signal," it should be noted that the initialization signal can actually be a radio wave signal or an IR signal as discussed above for controlling the display device 200. The initialization signal can be any signal that encodes specific information (e.g., a specific channel) rather than a "relative change" command. Therefore, the user or user device may not be aware that they are providing an initialization signal. For example, an application on a user device may present control options for controlling the display device 200 consisting only of specific inputs, without any "relative change" options. Therefore, any time a user decides to control the display device 200 with their user device, the user device may be effectively forced to provide specific information that the monitoring device 100 can use as an initialization signal.

[0067] Method 500 includes operation 504, which includes determining an initial state of the display device based at least in part on the initialization signal. The initial state may include, for example, a channel currently displayed on the display device and / or a current power state. The initial state may be determined similarly to determining the current state in operation 406 of method 400, for example, by extracting an operating instruction from the initialization signal.

[0068] The method 500 also includes an operation 506, which includes storing the initial state as the current state in a memory. Subsequently, the method 400 can be used to update the state based on newly received input.

[0069] Method 500 may be performed periodically, or each time a signal including specific information is received (e.g., when a user uses their user device rather than IR remote control 300 to control display apparatus 200). Method 500 may be performed during initial setup of monitoring device 100 and / or each time monitoring device 100 is powered on. In some examples, monitoring device 100 may be configured to request an initialization signal from the user device. For example, if no suitable signal is received for a predetermined period of time, monitoring device 100 may request an initialization signal. The user device may notify the user, prompting user input to generate an initialization signal. In other examples, the user device may be remote control 300. Monitoring device 100 may request an initialization signal from the viewer by presenting a notification on display apparatus 200 requesting the user to press a specific channel button or a button to select a channel, rather than a channel change button. Similarly, the monitoring device 100 may request an initialization signal related to a power state or volume level, for example by assigning individually numbered channel buttons to specific power / volume states and requesting the viewer to press the appropriate button on the remote control 300 to indicate the current power / volume state.

[0070] Verify viewer information

[0071] System Overview

[0072] Figure 4 An exemplary audience measurement system 600 is shown that includes a monitoring device 610. The monitoring device 610 can be the same or substantially the same as the monitoring device 100 and / or can include any or all of the features discussed above with respect to the monitoring device 100. In particular, the monitoring device 610 can include the IR receiver 102, the processor 104, the memory 106, and / or the radio wave receiver 112.

[0073] Audience measurement system 600 can be used to monitor display device 200 and viewers of display device 200. In particular, audience measurement system 600 can be configured to determine viewer information that specifies who is viewing display device 200, such as at a specific time and / or when specific content is displayed on display device 200. Audience measurement system 600 can be a TV audience measurement system (TAMS). Audience measurement system 600 can be used to monitor viewers of broadcast media. Broadcast media can refer to content that is transmitted to a general audience (e.g., via radio waves or cable).

[0074] As discussed above, the display device 200 can be a TV or any other display. The display device 200 can be controllable via the remote control 300 and / or via the user device 700. For example, an application running on the user device 700 can provide user-selectable objects for controlling the display device 200. In some examples, the display device 200 can be controlled via the monitoring device 610. For example, the remote control / user device can transmit a signal to the monitoring device 610, which can then transmit the signal to control the display device. The monitoring device 610 can also be configured to receive signals from the user device 700 and / or the remote control 300, the signals including viewer information or other data for the audience monitoring system 600.

[0075] The monitoring device 610 can be co-located with the display device 200 or otherwise associated with it, for example, in the same building or room as the display device 200. The monitoring device can be a standalone device or can be incorporated into another component associated with the display device 200, such as a set-top box. In some examples, the monitoring device 610 can be, include, or be part of a network router or modem. In particular, the monitoring device 610 can be part of a network router or modem through which the user device 700 connects to the Internet.

[0076] The monitoring device 610 can be configured to store viewer information 612. The viewer information can be stored in a memory, such as the memory 106. The viewer information 612 can identify one or more viewers of the display device 200, such as viewers at the current time or viewers at a previous time. The viewer information 612 can be determined by the monitoring device 610 itself, typically by the audience measurement system 610, from user input, or by any other method. As discussed further below with respect to the method 900, the viewer information 612 can be automatically verified by the monitoring device 610.

[0077] The monitoring device 610 includes a wireless signal receiver 614. The wireless signal receiver 614 can be the radio wave signal receiver 112, as discussed above. The wireless signal receiver 614 can be a Wi-Fi signal receiver or a Bluetooth signal receiver. The wireless signal receiver 614 can be configured to receive signals from the user device 700. For example, the wireless signal receiver 614 can be configured to receive signals from the user device 700 representing viewer information (such as viewer information entered by a user on the user device 700). As discussed further below, the wireless signal receiver 614 can alternatively or additionally be a wireless signal sniffer, i.e., configured to capture and read wireless signals intended for a different device or system.

[0078] In some examples, the audience measurement system 600 may include a remote server 620. The remote server 620 may be remote from the display apparatus 200 and the monitoring device 610. The remote server 620 may be configured to receive signals from the monitoring device 610 and transmit signals to the monitoring device. For example, the remote server 620 and the monitoring device 610 may communicate via the Internet or any other network. The monitoring device 610 may transmit collected information to the remote server 620. The remote server 620 may store the information received from the monitoring device 610 and compare this information with information received from other monitoring devices 610 associated with other display apparatuses 200. In particular, the remote server 620 may store viewer information 622, for example, in a memory. The viewer information 622 may include information initially collected by the monitoring device 610 and then transmitted to the remote server 620. The remote server 620 may also receive information directly from a user device 700 (e.g., a user's smartphone). For example, the user device 700 may be running an application associated with the audience measurement system 600. The user may enter information (e.g., viewer information, which may then be stored as viewer information 622) into the application, which may then be transmitted (e.g., via the Internet) to the remote server 620. In some examples, the remote server 620 may transmit some of the information received from the user device 700 to the monitoring device 610. This may be used, for example, in situations where the monitoring device 610 does not have a direct communication link with the user device 700. Similarly, the monitoring device 610 may send information (such as an initialization signal request as discussed above) to the user device 700 via the remote server 620.

[0079] Method for verifying initial viewer information

[0080] Figure 5 An exemplary method 900 for verifying viewer information is shown. Method 900 may be performed entirely by monitoring device 610, which includes one or more processors (such as processor 104) and one or more computer-readable media (such as memory 106) storing instructions that, when executed by the one or more processors, cause the monitoring device to perform method 900. In an alternative example, method 900 may generally be performed by audience measurement system 600. For example, some operations of method 900 may be performed by monitoring device 610, while other operations are performed by remote server 620, where both monitoring device 610 and remote server 620 include respective processors configured to perform respective operations of method 900.

[0081] Method 900 includes operation 902, at which initial viewer information 612, 622 is received by audience measurement system 600. Initial viewer information 612, 622 may be received by monitoring device 610 and / or by remote server 620. Initial viewer information 612, 622 identifies a first user as viewing display device 200 (i.e., the first user is considered a "viewer" of display device 200, such as a current viewer or a viewer at a particular time). Initial viewer information 612, 622 may also specify one or more additional users as viewers. Initial viewer information 612, 622 may or may have been generated based on information directed to audience measurement system 600. In other words, the information may be intended for audience measurement system 600, rather than for a different system (in contrast to operation 904 below). In some examples, initial viewer information 612, 622 may be generated based at least in part on receiving user input identifying the first user as viewing display device 200. For example, a user may enter viewer information into an application on the user device 700, which may then transmit the information to the audience measurement system 600 (e.g., via the wireless signal receiver 614 of the monitoring device 610). The user may be a first user who identifies themselves as the current viewer of the display apparatus 200. The user may be a different user who identifies the first user as a viewer. Thus, the method 900 may automatically verify the information entered by the user, which a conventional system may consider accurate. In other examples, the initial viewer information may be automatically determined, such as based on determining that the user device 700 is in proximity to the monitoring device 610 / display apparatus 200. Such methods may be based on the strength of a signal received from the user device 700 (wherein such a signal may be directed to the audience measurement system 600, such as as part of an identification protocol).

[0082] Method 900 includes operation 904, at which wireless signals transmitted between user device 700 and external system 800 are captured by monitoring device 610. The wireless signals can be detected by wireless signal receiver 614, which can then generate an electrical representation of the signals, which can be received at a processor of monitoring device 610. In some examples, wireless signals can be transmitted by user device 700 and can be directed to external system 800. In other examples, wireless signals can be transmitted from external system 800 and can be directed to user device 700. Although described herein as capturing wireless signals, other examples can alternatively (or additionally) capture wired signals transmitted between user device 700 and external system 800, such as signals transmitted via a wired network connection (e.g., an Ethernet connection). Method 900 can verify audience information in operation 906 below based at least in part on the captured wired signals.

[0083] The external system 800 can be a system not associated with the audience measurement system 600. The external system 800 can be a network router or modem. The external system 800 can be a remote system, such as a remote server. In such a case, the user device 700 can first communicate with the local router or modem, which can then transmit the information content of the wireless signal to the remote server (e.g., via the Internet). In some examples, the external system 800 can be associated with streaming media. In some examples, both the external system 800 and the monitoring device 610 (or remote server 620) can be separate components of a broader device / system. In such a case, the monitoring device 610 still captures / intercepts wireless signals that were originally intended to be received directly by the external system 800.

[0084] Thus, monitoring device 610 acts as a wireless signal sniffer. In a specific example, the wireless signal may be a Wi-Fi signal. Thus, monitoring device 610 may act as a Wi-Fi sniffer, capturing and reading Wi-Fi signals that are not originally intended for monitoring device 610 or, more generally, audience measurement system 600. For example, operation 904 may include receiving a wireless signal at monitoring device 610 and generating a copy of at least a portion of the wireless signal. The copy may then be transmitted so that the information contained in the wireless signal continues to its intended destination. In other examples, monitoring device 610 may intercept the wireless signal, preventing it from reaching its destination. Through such methods, neither the user nor user device 700 need to take any special action to enable verification of initial viewer information 610. For example, user device 700 does not need to transmit any dedicated signals to audience measurement system 600. Instead, monitoring device 610 utilizes incidental signals that may be transmitted to or from user device 700 during its normal operation. Such incidental signals may be associated with an operating system operating on user device 700 and / or with one or more applications running on user device 700 that are not associated with audience measurement system 600 .

[0085] Method 900 also includes operation 906. Operation 906 includes verifying, by the audience measurement system 600, the initial viewer information 612, 622 based at least in part on the wireless signal. For example, operation 906 may include determining whether the initial viewer information is incorrect or correct based at least in part on the wireless signal. If the initial viewer information 612, 622 is incorrect, operation 906 may also include generating updated viewer information 612, 622. The updated viewer information may be stored at the monitoring device 610 and / or may be transmitted to the remote server 620. Operation 906 may be performed by the monitoring device 610, the remote server 620, or any other component of the audience measurement system 600.

[0086] Where operation 904 involves copying a data packet of the wireless signal, operation 906 may involve analyzing the copy of the packet. For example, operation 906 may include identifying the user device 700 transmitting / receiving the wireless signal based on the source address or destination address of the data packet. The source / destination address of the data packet may be compared with the known address of the user device 700 to determine which user device 700 the wireless signal is associated with. The audience measurement system 600 may maintain a list of user devices 700 and associated users, and thus, by identifying the user device 700 from the wireless signal, the system 600 may identify the associated user. Operation 906 may include comparing the user identified using the initial viewer information 612, 622 with the user of the user device 700 associated with the wireless signal. The packet may also be analyzed to determine the content associated with the packet, such as whether the packet is related to streaming media.

[0087] In some examples, it may be determined that the wireless signal was transmitted by a user device 700 associated with the first user (i.e., the first user listed in the initial viewer information 612, 622). Verifying the initial viewer information 612, 622 may then include determining, by the audience measurement system 600 and based at least in part on the wireless signal, that the first user is not actually viewing the display device 200. If such a determination is made, operation 906 may also include removing, by the audience measurement system 600, the first user from the initial viewer information 612, 622. In other words, it may be as if the first user was never included in the viewer information 612, 622, thereby improving the accuracy of the recorded viewer information.

[0088] On the other hand, it can be determined based at least in part on the wireless signal that the first user is actually viewing the display device 200. In this case, verifying the initial viewer information 612, 622 can include marking the initial viewer information 612, 622 as correct or otherwise leaving the initial viewer information 612, 622 in an unmodified state.

[0089] In some cases, the first user may be listed in the initial viewer information, either by the user / users or automatically. For example, the first user may be near display device 200, and therefore it may be initially assumed that they are viewing display device 200. However, the first user may actually be viewing streaming media on their user device 700. Therefore, the first user may not actually be interacting with the content on display device 200 and should not be listed as a viewer. Accordingly, in some examples, operation 906 may include determining that the first user is not viewing display device 200 based on: audience measurement system 600 determining that a wireless signal is associated with streaming media displayed on user device 700. For example, data packets of the wireless signal may be read to identify source / destination addresses associated with external system 800. The address of external system 800 may then be compared to a list of known addresses of servers associated with streaming media. If the packet address matches an address on the list, it can be determined that user device 700 is displaying streaming media. Alternatively or additionally, the payload of the data packet may be analyzed to determine whether the data packet is associated with streaming media. Such an example may automatically check whether the user is actually looking at the display device 200 and, if not, automatically correct the viewer information 612 , 622 .

[0090] Figure 6a and Figure 6b A further example is shown which determines that the user is not actually looking at the display device 200 based on automatically detecting that the user identified in the initial viewer information 612 , 622 is not actually near the display device 200 , and therefore likely not looking at content on the display device 200 .

[0091] Figure 6a 6. A first user 750-1 and a second user 750-2 are shown positioned in a defined viewing zone 250 proximate to the display apparatus 200. The viewing zone can include a range of locations within a threshold distance of the display apparatus 200 and / or the monitoring device 610. Although shown as a rectangle, the viewing zone 250 can have any shape and size as desired, such as being selected to represent an area where viewers of the display apparatus 200 are expected to be located. The viewing zone 250 can be pre-set by the manufacturer of the monitoring device 610, or can be defined by a user on-site (e.g., during initial setup of the monitoring device 610).

[0092] Each user 750-1, 750-2 has a corresponding user device 700-1, 700-2 with them in the viewing area 250. The user devices 700-1, 700-2 transmit wireless (e.g., Wi-Fi) signals directed to the external device 800. These wireless signals can be captured by the monitoring device 610. The monitoring device 610 determines the signal strength of each wireless signal, such as the signal-to-noise ratio. In the illustrated example, both user devices 700-1, 700-2 are within the viewing area 250, and therefore the signal strength of both wireless signals is strong.

[0093] Figure 6b An example is shown in which a first user 750-1 has left viewing area 250, taking user device 700-1 with them. First user device 700-1 can continue to transmit wireless signals directed to external system 800, and at least some of these wireless signals can still be captured by monitoring device 610. However, first user device 700-1 is now farther away from monitoring device 610. As a result, the strength of the wireless signal from first user device 700-1 is now reduced compared to its previous strength. Monitoring device 610 can use this reduction in signal strength to determine that first user device 700-1 has left viewing area 250, and therefore, that first user 750-1 has left the viewing area. Monitoring device 610 can therefore determine that first user 750-1 is not actually viewing display apparatus 200. For example, monitoring device 610 can compare the change in signal strength (e.g., absolute change, proportional change) to a threshold associated with the boundaries of viewing area 250. Viewing area 250 itself can be defined by a predetermined threshold for comparing wireless signal changes. In such an example, monitoring device 610 may deem that the first user is not viewing display apparatus 200 only if user device 700-1 remains outside viewing area 250 for more than a predetermined minimum amount of time. For example, monitoring device 610 may capture multiple signals from user device 700-1 over a period of time to determine whether user device 700-1 remains outside viewing area 250. The minimum amount of time may be 2 minutes, 5 minutes, 10 minutes, or any other amount of time.

[0094] Accordingly, in some examples, determining that the first user 750-1 is not viewing the display apparatus 200 can include determining that the user device 700-1 associated with the first user 750-1 is outside the viewing zone 250 associated with the display apparatus 200 based at least in part on the strength of the wireless signal captured in operation 804. In one example, a monitoring device captures a first wireless signal and a second wireless signal from the first user device 700-1. A difference between the strength of the first wireless signal and the strength of the second wireless signal is determined. Then, based at least in part on the difference, it can be determined that the second wireless signal was transmitted by the user device 700-1 from outside the viewing zone 250. In this case, the first user 750-1 can be removed from the initial viewer information 612, 622 (i.e., the initial information is corrected). In an alternative example, updated viewer information can be generated instead of replacing the initial information. Determining movement of user equipment 700 based on changes in the strength of signals from the same user equipment 700 rather than using absolute signal strength has the advantage of controlling for inherent differences in signal strength of signals transmitted by different types of user equipment 700 (e.g. due to different transmission powers of different user equipment 700).

[0095] In some examples, the monitoring device may store the strength of a wireless signal associated with a first wireless signal (i.e., a signal received when the first user device 700-1 is in the viewing zone 250). For example, the first wireless signal may be captured during initial setup of the monitoring device 610 or when the first user 750-1 is added as a user in the audience measurement system 600. This stored signal strength may then be used to determine whether future signals received from the first user device are transmitted from inside or outside the viewing zone 250, and therefore verify whether the first user 750-1 is viewing the display apparatus 200.

[0096] In some examples, when it is determined that user device 700-1 has left (or entered) viewing area 250, an additional check may be performed to confirm that user 750-1 is no longer viewing display apparatus 200. For example, verifying the initial viewer information may include both: determining that user device 700-1 of first user 750-1 is inside / outside viewing area 250 based on signal strength; and determining that signals transmitted to / from a computing device associated with the first user 750-1 are associated with streaming media. The computing device associated with first user 750-1 may be user device 700-1, and detecting signals transmitted to / from the device may include wireless sniffing as discussed above. In other examples, the computing device (which may be user device 700-1) may have a wired network connection, such as a wired network connection with a modem. In such cases, signals transmitted to / from the computing device may be sent via a wired connection rather than wirelessly. Monitoring device 610 (e.g., where at least a portion of monitoring device 610 is incorporated into a router / modem) can receive and analyze the wired signal similar to the methods discussed above for wireless signals to determine whether the signal is associated with streaming media. In such examples, the combination of the two determinations can provide a higher degree of certainty that the first user is indeed or not viewing display apparatus 200, thereby improving the accuracy of the data collected by audience measurement system 600. For example, a method can determine that first user 750-1 has left viewing area 250 and subsequently determine that the computing device of first user 750-1 is associated with streaming media (e.g., within a predetermined time period after first user 750-1 left viewing area 250), thereby providing greater certainty that the first user is no longer viewing display apparatus 200. Alternatively, a method can detect that a computing device associated with first user 750-1 that was transmitting / receiving a signal associated with streaming media has ceased doing so and that first user 750-1 has entered viewing area 250 (e.g., within a predetermined time period after the end of the streaming media signal). In such cases, the monitoring device 610 can be more certain that the first user 750 - 1 is now viewing the display apparatus 200 .

[0097] As a corollary to removing a user from the initial viewing information 612, the methods of the present description may alternatively or additionally add a user that was not included in the initial viewer information 612. For example, operation 906 of method 900 may include determining that the captured wireless signal is associated with the second user device 700-2 of the second user 700-2. If the second user 750-2 is not included as a viewer in the initial viewer information 612, 622, the initial viewer information 612, 622 may be corrected to include the second user 700-2. In some examples, it may be determined that the second user 750-2 is viewing the display device 200 by determining, at least in part based on the strength of the wireless signal, that the second user device 700-2 is within the viewing zone 250 associated with the display device 200, such as Figure 6a and Figure 6b shown.

[0098] References in this article Figures 1 to 6b At least some aspects of the described examples include computer processes executed in a processing system or processor. However, in some examples, the present disclosure also extends to computer programs, in particular computer programs on or in an apparatus suitable for putting the present disclosure into practice. The program may be in the form of: non-transitory source code, object code, code intermediate source and object code in form such as partially compiled; or any other non-transitory form suitable for implementing a process according to the present disclosure. The apparatus may be any entity or device capable of carrying the program. For example, the apparatus may include a storage medium such as: a solid state drive (SSD) or other semiconductor-based RAM; a ROM, for example, a CD ROM or a semiconductor ROM; a magnetic recording medium, for example, a floppy disk or a hard disk; a general optical storage device, etc.

[0099] The above embodiments should be understood as illustrative examples of the present disclosure. Additional embodiments are contemplated. It should be understood that any feature described with respect to any embodiment may be used alone or in combination with other features described, and may also be used in combination with one or more features of any other embodiment in the embodiment or any combination of any other embodiment in the embodiment. In addition, equivalents and modifications not described above may also be employed without departing from the scope of the embodiments defined in the appended claims.

[0100] This manual contains the following numbered clauses:

[0101] 1. A monitoring device for monitoring a status of a display device, the monitoring device comprising: an infrared (IR) receiver for detecting an IR signal transmitted from a remote controller; a processor configured to determine an operation instruction for operating the display device from the IR signal, wherein the operation instruction comprises a channel change instruction and / or a power instruction; and a memory configured to store a current status of the display device, wherein the current status comprises a channel and / or a power status displayed on the display device; wherein the processor is configured to determine an updated status of the display device based at least in part on the operation instruction, and replace the current status stored in the memory with the updated status.

[0102] 2. The monitoring device of clause 1, wherein the processor is configured to determine the updated state of the display based at least in part on the operating instructions and the current state stored in the memory.

[0103] 3. A monitoring device according to clause 1 or clause 2, wherein: the operating instruction includes the channel change instruction; the channel change instruction includes a channel up instruction or a channel down instruction; and the processor is configured to determine the updated channel displayed on the display device based at least in part on the current state stored in the memory and the channel up instruction or the channel down instruction.

[0104] 4. A monitoring device according to any of the preceding clauses, wherein the processor is configured to perform an initialization operation to initialize the current state stored in the memory, the initialization operation comprising: receiving an initialization signal from a user device, the initialization signal comprising information specifying a channel for display on the display device and / or information specifying a power state of the display device; determining an initial state of the display device based at least in part on the initialization signal, the initial state comprising a channel currently displayed on the display device and / or a current power state; and storing the initial state in the memory as the current state.

[0105] 5. The monitoring device of clause 4, wherein the monitoring device is configured to request the initialization signal from the user equipment.

[0106] 6. A monitoring device according to any of the preceding clauses, wherein: the monitoring device also includes a radio wave receiver for receiving a radio wave signal from the or a user device; and the processor is configured to determine a further updated state of the display device based at least in part on the radio wave signal.

[0107] 7. The monitoring apparatus according to clause 6, wherein the radio wave signal includes an operation instruction for operating the display device, or wherein the radio wave signal includes user-input information indicating a current state of the display device.

[0108] 8. A monitoring device according to clause 6 or clause 7, wherein the radio wave signal is associated with an application operating on the user device, the application being associated with controlling and / or monitoring the display apparatus.

[0109] 9. The monitoring device according to any one of clauses 6 to 8, wherein the radio wave signal is a Wi-Fi signal or a Bluetooth signal.

[0110] 10. A monitoring device according to any one of clauses 4 to 9, wherein the user device is a computing device, a portable computing device, a smartphone, a tablet, a laptop or a wearable device.

[0111] 11. A monitoring device according to any of the preceding clauses, wherein the IR signal includes a signal code representing the operating instruction, and wherein the processor is configured to determine the operating instruction from the IR signal by: comparing the signal code with a plurality of stored codes, each stored code being associated with a corresponding known operating instruction; identifying the matching code from the plurality of stored codes based on a similarity between the signal code and the matching code; and identifying the known operating instruction associated with the matching code as the operating instruction of the IR signal.

[0112] 12. The monitoring device of clause 11, wherein the processor is configured to: receive an identification of the display device from a user device; and identify the plurality of stored codes based on the identification of the display device.

[0113] 13. Monitoring apparatus according to any of the preceding clauses, wherein the remote control directly controls the display device.

[0114] 14. A monitoring device according to any of the preceding clauses, wherein the processor is configured to replace the current state with the updated state by storing in the memory: the current state, as a previous state; and a time associated with the previous state.

[0115] 15. Monitoring device according to any of the preceding clauses, wherein the monitoring device further comprises a network connection for transmitting the status of the display device to a remote server.

[0116] 16. Monitoring apparatus according to any of the preceding clauses, wherein the processor is configured to identify content displayed on the display device based on the current state and a time associated with the state stored in the memory.

[0117] 17. Monitoring apparatus according to any of the preceding clauses, wherein the memory is further configured to store viewer information associated with the state of the display device.

[0118] 18. A monitoring apparatus according to any preceding clause, wherein the display device is or comprises one or more of a television, a non-smart TV, a smart TV, a set-top box and a streaming device.

[0119] 19. A monitoring device according to any preceding clause, wherein the monitoring device is a television audience measurement system.

[0120] 20. A computer-implemented method for monitoring the status of a display device, the method comprising: receiving an infrared (IR) signal transmitted from a remote control to the display device at a monitoring device separate from the display device; determining an operating instruction for operating the display device from the IR signal, wherein the operating instruction includes a channel change instruction and / or a power instruction; determining a current status of the display device based at least in part on the operating instruction, wherein the current status includes a channel and / or power status displayed on the display device; and storing the current status of the display device in a memory.

[0121] 21. The method of clause 20, comprising determining the current state based at least in part on the operating instructions and a previous state stored in the memory.

[0122] 22. The method of clause 20 or clause 21, further comprising: receiving, by the monitoring device, a wireless signal from a user device; and determining an updated state of the display apparatus based on the wireless signal.

[0123] 23. The method according to any one of clauses 20 to 22, further comprising: receiving an initialization signal, the initialization signal including information specifying a channel for display on the display device and / or information specifying a power state of the display device; identifying a channel currently displayed on the display device and / or a current power state of the display device from the initialization signal; and storing an initial state in the memory, the initial state including the currently displayed channel and / or the current power state as the current state of the display device.

[0124] 24. The method of clause 23, further comprising requesting the initialization signal from a user equipment.

[0125] 25. The method of any one of clauses 20 to 24, further comprising transmitting the current state of the display device to a remote server.

[0126] 26. The method of any of clauses 20 to 25, further comprising identifying content displayed on the display device based on a state of the display device and a time associated with the state.

[0127] 27. A method according to any of clauses 20 to 26, further comprising storing a previous state of the display device and a time associated with the previous state.

[0128] 28. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method according to any of clauses 20 to 27.

[0129] 29. A computer-readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method of any one of clauses 20 to 27.

[0130] 30. A computer-implemented method for verifying viewer information associated with a display device in an audience measurement system, wherein the audience measurement system is used to monitor viewers of broadcast media, and wherein the method includes: receiving initial viewer information by the audience measurement system, the initial viewer information identifying a first user as viewing the display device; capturing, by a monitoring device of the audience measurement system associated with the display device, a wireless signal transmitted between a user device and an external system; and verifying, by the audience measurement system, the initial viewer information based at least in part on the wireless signal.

[0131] 31. The method of clause 30, wherein the initial viewer information is generated based on information directed to the audience measurement system.

[0132] 32. The method of clause 30 or clause 31, wherein the initial viewer information is generated based at least in part on receiving user input identifying the first user as viewing the display device.

[0133] 33. A method according to any one of clauses 30 to 32, wherein the user device is associated with the first user, and wherein verifying the initial viewer information includes determining by the audience measurement system and at least in part based on the wireless signal that the first user is not viewing the display device.

[0134] 34. The method of clause 34, comprising removing, by the audience measurement system, the first user from initial audience information.

[0135] 35. The method of clause 33 or clause 34, wherein determining that the first user is not viewing the display apparatus comprises determining that the user device is outside of a viewing zone associated with the display apparatus based at least in part on a strength of the wireless signal.

[0136] 36. A method according to clause 35, wherein the wireless signal is a first wireless signal, and wherein the method includes: receiving a second wireless signal transmitted by the user device after the first wireless signal; determining a difference between the strength of the first wireless signal and the strength of the second wireless signal; and determining, at least in part based on the difference, that the second wireless signal is transmitted by the user device from outside the viewing area.

[0137] 37. The method of clause 33 or clause 34, wherein determining that the first user is not viewing the display device comprises determining, by the audience measurement system, that the wireless signal is associated with streaming media displayed on the user equipment.

[0138] 38. The method of clause 37, wherein the wireless signal comprises a data packet, and wherein determining that the wireless signal is associated with streaming media comprises identifying a destination address of the data packet and / or analyzing a payload of the data packet.

[0139] 39. A method according to any one of clauses 30 to 32, wherein the user device is associated with a second user not identified in the initial viewer information, and wherein verifying the initial viewer information includes determining by the audience measurement system and at least in part based on the wireless signal that the second user is viewing the display device.

[0140] 40. The method of clause 39, wherein determining that the second user is viewing the display apparatus comprises determining that the user device is within a viewing zone associated with the display apparatus based at least in part on a strength of the wireless signal.

[0141] 41. The method of clause 39 or clause 40, comprising adding, by the audience measurement system, the second user to the initial viewer information.

[0142] 42. A method according to any of the preceding clauses, wherein: capturing the wireless signal includes receiving the wireless signal at the monitoring device and generating a copy of at least a portion of the wireless signal; and verifying the initial viewer information based at least in part on the wireless signal includes analyzing the copy of at least a portion of the wireless signal.

[0143] 43. A method according to any of the preceding clauses, wherein the monitoring device is a network router or modem, includes the network router or the modem, or is part of the network router or the modem; or wherein the monitoring device is an independent monitoring device associated with the display device.

[0144] 44. A method according to any preceding clause, wherein the wireless signal comprises a data packet, and wherein the method comprises identifying the user equipment transmitting the wireless signal from a source address of the data packet.

[0145] 45. The method of any of the preceding clauses, wherein verifying the initial viewer information comprises determining that the initial viewer information is incorrect based at least in part on the wireless signal.

[0146] 46. ​​The method of clause 45, further comprising generating updated viewer information.

[0147] 47. A method according to any of the preceding clauses, wherein the wireless signal is a Wi-Fi signal.

[0148] 48. A method according to any of the preceding clauses, wherein the display device is or comprises one or more of a television, a non-smart TV, a smart TV, a set-top box, and a streaming device.

[0149] 49. A monitoring device for monitoring a display device, the monitoring device comprising: a wireless signal receiver for detecting wireless signals transmitted by a user device; one or more processors; and one or more computer-readable media storing instructions, which, when executed, cause the monitoring device to perform a method according to any one of clauses 30 to 48.

[0150] 50. The apparatus of clause 49, wherein the apparatus is configured to determine a status of the display device.

[0151] 51. An audience measurement system comprising a monitoring device according to clause 49 or clause 50.

[0152] 52. An audience measurement system comprising: one or more processors; and one or more computer-readable media storing instructions that, when executed, cause the monitoring device to perform the method of any one of clauses 30 to 48.

[0153] 53. The audience measurement system of clause 52, comprising a monitoring device for monitoring the display apparatus, wherein the monitoring device comprises a wireless signal receiver for receiving a wireless signal transmitted by a user device.

[0154] 54. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method according to any of clauses 30 to 48.

[0155] 55. A computer-readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method of any one of clauses 30 to 48.

Claims

1. A monitoring device for monitoring the status of a display device, the monitoring device comprising: an infrared (IR) receiver for detecting an IR signal transmitted from a remote control; a processor configured to determine an operation instruction for operating the display device from the IR signal, wherein the operation instruction comprises a channel change instruction and / or a power instruction; as well as a memory configured to store a current state of the display device, the current state including a channel displayed on the display device and / or a power state; The processor is configured to determine an updated state of the display device based at least in part on the operating instructions, and replace the current state stored in the memory with the updated state. 2 . The monitoring device of claim 1 , wherein the processor is configured to determine the updated state of the display based at least in part on the operating instructions and the current state stored in the memory.

3. The monitoring device according to claim 1 or claim 2, wherein: The operation instruction includes the channel change instruction; The channel change instruction includes a channel up instruction or a channel down instruction; and The processor is configured to determine an updated channel to display on the display device based at least in part on the current state stored in the memory and the channel up instruction or the channel down instruction.

4. The monitoring device according to any one of the preceding claims, wherein the processor is configured to perform an initialization operation to initialize the current state stored in the memory, the initialization operation comprising: receiving an initialization signal from a user device, the initialization signal including information specifying a channel for display on the display device and / or information specifying a power state of the display device; determining an initial state of the display device based at least in part on the initialization signal, the initial state comprising a channel currently displayed on the display device and / or a current power state; as well as The initial state is stored in the memory as the current state. The monitoring device according to claim 4 , wherein the monitoring device is configured to request the initialization signal from the user equipment.

6. A monitoring device according to any one of the preceding claims, wherein: The monitoring device further comprises a radio wave receiver for receiving a radio wave signal from the or a user device; and The processor is configured to determine a further updated state of the display device based at least in part on the radio wave signal. 7 . The monitoring apparatus according to claim 6 , wherein the radio wave signal includes an operation instruction for operating the display device, or wherein the radio wave signal includes information input by a user indicating a current state of the display device.

8. The monitoring device according to claim 6 or claim 7, wherein the radio wave signal is associated with an application operating on the user device, the application being associated with controlling and / or monitoring the display apparatus. 9 . The monitoring device according to claim 6 , wherein the radio wave signal is a Wi-Fi signal or a Bluetooth signal.

10. The monitoring device according to any one of claims 4 to 9, wherein the user device is a computing device, a portable computing device, a smartphone, a tablet computer, a portable computer or a wearable device.

11. The monitoring device of any one of the preceding claims, wherein the IR signal includes a signal code representing the operating instruction, and wherein the processor is configured to determine the operating instruction from the IR signal by: comparing the signal code to a plurality of stored codes, each stored code being associated with a corresponding known operating instruction; identifying the matching code from the plurality of stored codes based on a similarity between the signal code and a matching code; and A known operating instruction associated with the matching code is identified as the operating instruction of the IR signal.

12. The monitoring device of claim 11 , wherein the processor is configured to: receiving an identification of the display device from a user device; and The plurality of stored codes are identified based on the identification of the display device.

13. Monitoring apparatus according to any one of the preceding claims, wherein the remote control directly controls the display device.

14. A monitoring device according to any one of the preceding claims, wherein the processor is configured to replace the current state with the updated state by storing in the memory: the current state as a previous state; and a time associated with the previous state.

15. Monitoring apparatus according to any one of the preceding claims, wherein the monitoring apparatus further comprises a network connection for transmitting the status of the display device to a remote server.

16. A monitoring apparatus according to any preceding claim, wherein the processor is configured to identify content displayed on the display device based on the current state and a time associated with the state stored in the memory.

17. A monitoring device according to any preceding claim, wherein the memory is further configured to store viewer information associated with the state of the display apparatus.

18. The monitoring apparatus of any preceding claim, wherein the display device is or comprises one or more of a television, a non-smart TV, a smart TV, a set-top box, and a streaming device.

19. A monitoring device according to any preceding claim, wherein the monitoring device is a television audience measurement system.

20. A computer-implemented method for monitoring a status of a display device, the method comprising: receiving, at a monitoring device separate from the display device, an infrared (IR) signal transmitted from a remote controller to the display device; determining an operation instruction for operating the display device from the IR signal, wherein the operation instruction includes a channel change instruction and / or a power instruction; determining a current state of the display device based at least in part on the operating instruction, the current state including a channel displayed on the display device and / or a power state; as well as The current state of the display device is stored in a memory.

21. The method of claim 20, comprising determining the current state based at least in part on the operating instructions and a previous state stored in the memory.

22. The method according to claim 20 or claim 21, further comprising: The monitoring device receives a wireless signal from a user device; as well as An updated status of the display device is determined based on the wireless signal.

23. The method according to any one of claims 20 to 22, further comprising: receiving an initialization signal, the initialization signal including information specifying a channel for display on the display device and / or information specifying a power state of the display device; identifying, from the initialization signal, a channel currently displayed on the display device and / or a current power state of the display device; as well as An initial state is stored in the memory, the initial state including the currently displayed channel and / or the current power state as the current state of the display device.

24. The method of claim 23, further comprising requesting the initialization signal from a user equipment.

25. The method according to any one of claims 20 to 24, further comprising transmitting the current state of the display device to a remote server.

26. The method of any one of claims 20 to 25, further comprising identifying content displayed on the display device based on a state of the display device and a time associated with the state.

27. The method of any one of claims 20 to 26, further comprising storing a previous state of the display device and a time associated with the previous state.

28. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method according to any one of claims 20 to 27.

29. A computer readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method according to any one of claims 20 to 27.

30. A computer-implemented method of verifying viewer information associated with a display device in an audience measurement system, wherein the audience measurement system is used to monitor viewers of broadcast media, and wherein the method comprises: receiving, by the audience measurement system, initial viewer information identifying a first user as viewing the display device; capturing, by a monitoring device of the audience measurement system associated with the display device, wireless signals transmitted between a user device and an external system; as well as The initial viewer information is verified by the audience measurement system based at least in part on the wireless signal.

31. The method of claim 30, wherein the initial viewer information is generated based on information directed to the audience measurement system.

32. A method according to claim 30 or claim 31 , wherein the initial viewer information is generated based at least in part on receiving user input identifying the first user as viewing the display device.

33. A method according to any one of claims 30 to 32, wherein the user device is associated with the first user, and wherein verifying the initial viewer information includes determining by the audience measurement system that the first user is not viewing the display device based at least in part on the wireless signal.

34. The method of claim 33, comprising removing, by the audience measurement system, the first user from initial audience information.

35. The method of claim 33 or claim 34, wherein determining that the first user is not viewing the display apparatus comprises determining that the user device is outside of a viewing zone associated with the display apparatus based at least in part on a strength of the wireless signal.

36. The method of claim 35, wherein the wireless signal is a first wireless signal, and wherein the method comprises: receiving a second wireless signal transmitted by the user equipment after the first wireless signal; determining a difference between a strength of the first wireless signal and a strength of the second wireless signal; as well as A determination is made based at least in part on the difference that the second wireless signal was transmitted by the user device from outside the viewing zone.

37. The method of claim 33 or claim 34, wherein determining that the first user is not viewing the display device comprises determining, by the audience measurement system, that the wireless signal is associated with streaming media displayed on the user equipment.

38. The method of claim 37, wherein the wireless signal comprises a data packet, and wherein determining that the wireless signal is associated with streaming media comprises identifying a destination address of the data packet and / or analyzing a payload of the data packet.

39. A method according to any one of claims 30 to 32, wherein the user device is associated with a second user not identified in the initial viewer information, and wherein verifying the initial viewer information includes determining by the audience measurement system that the second user is viewing the display device based at least in part on the wireless signal.

40. The method of claim 39, wherein determining that the second user is viewing the display apparatus comprises determining that the user device is within a viewing zone associated with the display apparatus based at least in part on a strength of the wireless signal.

41. A method according to claim 39 or claim 40, comprising adding, by the audience measurement system, the second user to the initial viewer information.

42. The method according to any one of claims 30 to 41, wherein: Capturing the wireless signal includes receiving the wireless signal at the monitoring device and generating a copy of at least a portion of the wireless signal; And verifying the initial viewer information based at least in part on the wireless signal includes analyzing the copy of the at least a portion of the wireless signal.

43. A method according to any one of claims 30 to 42, wherein the monitoring device is, comprises or is part of a network router or modem; or The monitoring device is an independent monitoring device associated with the display apparatus.

44. A method according to any one of claims 30 to 43, wherein the wireless signal comprises a data packet, and wherein the method comprises identifying the user equipment transmitting the wireless signal from a source address of the data packet.

45. The method of any one of claims 30 to 44, wherein verifying the initial viewer information comprises determining that the initial viewer information is incorrect based at least in part on the wireless signal.

46. ​​The method of claim 45, further comprising generating updated viewer information.

47. The method of any one of claims 30 to 46, wherein the wireless signal is a Wi-Fi signal.

48. The method of any one of claims 30 to 47, wherein the display device is or comprises one or more of a television, a non-smart TV, a smart TV, a set-top box, and a streaming device.

49. A monitoring device for monitoring a display apparatus, the monitoring device comprising: a wireless signal receiver for detecting wireless signals transmitted by user equipment; one or more processors; as well as One or more computer readable media storing instructions which, when executed, cause the monitoring device to perform the method according to any one of claims 1 to 19.

50. The apparatus of claim 49, wherein the apparatus is configured to determine a status of the display device.

51. An audience measurement system comprising a monitoring device according to claim 49 or claim 50.

52. An audience measurement system, comprising: one or more processors; as well as One or more computer readable media storing instructions which, when executed, cause the monitoring device to perform the method of any one of claims 30 to 48.

53. The audience measurement system of claim 52, comprising a monitoring device for monitoring the display apparatus, wherein the monitoring device comprises a wireless signal receiver for receiving a wireless signal transmitted by a user device.

54. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method according to any one of claims 30 to 48.

55. A computer readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method of any one of claims 30 to 48.

Images