Apparatus and method for capturing attention of observer

Abstract

The present invention relates to a device for capturing, with a remote control, an attention of an observer on a multimedia media playback playing on a screen when a request for the observer to press a behavior call button (CTA button) of the remote control is displayed on the screen, the device comprising a clock for: when the observer touches the CTA button on the remote control, the CTA button on the remote control; creating a touch timestamp; creating a release timestamp when the observer stops touching the CTA button on the remote controller; and creating a trigger timestamp when the observer presses the CTA button on the remote control.

Description

Technical Field

[0001] The present invention relates to a device for capturing the attention of an observer, a remote controller connected to the device, and a system comprising the device and the remote controller. Background Art

[0002] US2015100167AA discloses a smart home system with a remote control on which special buttons called lens buttons are arranged with transparent surfaces. In addition to inputting commands, these buttons can also be used as visual indicators. A light ring installed behind these buttons can indicate the status of smart devices. The smart home system also includes a hazard detector with seven different sensors, including smoke, heat and carbon monoxide sensors for triggering an alarm signal and issuing a call to action to notify the user of what type of hazard (e.g., smoke or carbon monoxide) is detected and where the hazard is located (e.g., in the living room or bedroom). The call to action contains specific instructions for additional actions, such as "leave the room now" or "get some fresh air".

[0003] US2018 / 0098109A1 discloses a system for controlling an image display device using a remote controller with a touch screen. Compared with conventional remote controllers, the remote controller displays various device settings and functions, enables precise micro-control, and reduces the number of physical buttons. The interaction between the remote controller and the image display device is local, wherein the remote controller is capable of receiving complex user commands and performing corresponding functions on the image display device. Detecting the duration of a button press enables the remote controller to distinguish between different types of inputs (e.g., short button presses and long button presses) and trigger different functions accordingly.

[0004] US2015 / 0121412A1 discloses a system that controls notifications on network-enabled televisions and other connected multimedia devices to enhance the viewer experience. The system allows users to suppress or control unwanted notifications that may be distracting while watching TV. This is achieved through various methods, such as long pressing a button on a remote control, double-clicking a mute button, or using a special notification mute button. The purpose of controlling and suppressing notifications is to keep the viewer immersed in the TV content and minimize distractions. A timestamp can be captured to identify a long button press, and thus suppress notifications for a certain time or suppress notifications until the button is pressed again.

[0005] The publication MDN Web Docs "PerformanceAPI - PerformancePaintTiming", dated July 7, 2023, available at the URL https: / / developer.mozilla.org / en-US / docs / Web / API / PerformancePaintTiming, discloses a PerformancePaintTiming API that captures timestamps for rendering content on a web page. In particular, it records the time of first rendering (first paint) and the time of first rendering of text or image content (first content paint). This information is used to improve the responsiveness and performance of a website by minimizing the time it takes for a user to view content.

[0006] The object of the invention is to improve the known systems. Summary of the invention

[0007] According to one aspect of the present invention, a device is provided for capturing the observer's attention to the playback of multimedia media played on the screen using a remote control when a request for the observer to press a call to action (CTA) button of the remote control is displayed on the screen, the device comprising: a clock for creating a touch timestamp when the observer touches the CTA button on the remote control, for creating a release timestamp when the observer stops touching the CTA button on the remote control, and for creating a trigger timestamp when the observer presses the CTA button on the remote control.

[0008] A call to action button (hereinafter referred to as a CTA button) is a button on a remote control or an interactive button in a user interface that prompts or guides the user to take a specific action. These buttons are usually designed to be eye-catching and may contain short and concise text that prompts the user to interact, such as "Get help now", "Send an alarm", or "Send an emergency call". CTA buttons appear as configuration elements from the design of websites, applications, and other user interfaces, and play a decisive role in user guidance and conversion optimization. Clicking a CTA button can usually achieve a specific goal, such as alerting the nearest emergency service agency, automatically dialing a predefined emergency call, or initiating a special safety protocol. In the context of the present invention described below, CTA buttons should not be understood in a restrictive manner.

[0009] The designation is based on the idea that it is not only necessary to determine whether an observer perceives certain messages, but also to gain clues about how the observer receives the message. For example, messages warning of an impending disaster are highly emotional and urgent in nature. Transmitting these message warnings quickly and accurately can save lives and help affected communities prepare and react appropriately. The designation allows media organizations to gain a deeper understanding of how individuals react to such news.

[0010] Touch timestamps provide valuable data about how quickly viewers responded to the information or prompts presented. Even if viewers ultimately choose not to press the CTA button, the mere touch demonstrates their attention and interest in the message.

[0011] The linking of touch and release timestamps also allows conclusions to be drawn about the duration of the observer's decision process. Each decision first requires perceptual information (in this case a multimedia presentation prompting the observer to confirm via the CTA button). This information is processed in the brain and compared with existing knowledge, experience and memory. The brain evaluates the available options and makes a choice. This process can occur at both a conscious and unconscious level. The result itself is reflected in the observer's action: pressing or not pressing the CTA button.

[0012] This behavior provides valuable data for future multimedia presentations and allows content to be better aligned with the viewer's decision-making process. Emotions are known to be important influencers of decision making, as they can influence the attractiveness or rejection of options. By tailoring emotional content in multimedia presentations and then measuring reactions to them, its effectiveness can be better assessed.

[0013] Such data also provides insights into observers’ cognitive biases that influence their information processing and responses. Conclusions can also be drawn about social and environmental influencing factors, such as peer pressure, social norms, or cultural expectations. In particular, ignoring requests can provide valuable insights into group dynamics. This is invaluable in the transmission of emergency messages, as it could potentially save lives.

[0014] In another embodiment of the disclosed device, the display instruction includes displaying a CTA button on the screen. In this way, a visual representation of the CTA button is enabled on the screen, which serves as a visual confirmation for the observer. This is particularly useful when the remote control has multiple buttons or the design of the CTA button is not immediately recognizable. The direct visual association between what is displayed on the screen and what the observer expects to do increases the likelihood of a correct and quick response. Displaying the CTA button on the screen also draws the observer's attention directly to the desired action and reduces potential distraction or confusion. This represents an intuitive "guide to action" that significantly simplifies the observer's decision-making process. By visually perceiving the CTA button in the context of the message or information, the observer can also better understand the context. This is particularly important when there are several possible actions or reactions to the message. The visual presentation of the CTA button can also be used to create an emotional response or connection. For example, the button can be presented in a color or shape that signals urgency, importance, or other emotions. Seeing the physical action presented on the screen also enhances the interactivity and engagement of the observer. This creates a sense of engagement and therefore increases the engagement and response of the observer. If there is additional information or instructions associated with the CTA button, this can be presented directly next to the visually presented button, providing clarity and reducing potential misunderstandings.

[0015] In a further embodiment, the designation device comprises a communication interface arranged to send a change instruction to the remote control so as to request the observer to press the CTA button and change the appearance of the CTA button. In this way, changes (particularly visual or tactile changes) are used to attract the user's attention to the CTA button. If the CTA button lights up, vibrates, is raised above the button image, or begins to change in any way from its normal state, the observer may respond more quickly because these changes are difficult to miss or feel. According to the speed of the state change, for example, by using the rapid flashing or vibration of the CTA button, urgency or importance is indicated. This is particularly useful when an immediate response from the observer is required (for example, in the case of an emergency message). One way to change the state of the CTA from its normal state is a tactile change, such as lifting the button, which provides a physically perceptible help for the user in identifying the CTA button. In addition, people with impaired vision or other impairments can benefit from tactile or auditory changes because they do not rely solely on visual cues. By changing the state of the CTA button according to the prompt to press the CTA button, a clear and perceptible distinction can be made between different types of prompts or messages. Changing the CTA button also increases the observer's sense of interaction and engagement. This creates a more dynamic user experience and can therefore increase observer engagement and response. Tactile or visual stimulation influences the observer's decision-making process. For example, a pleasant glow or vibration can cause positive associations and make the user more likely to press the button. Finally, the way the CTA button is changed can vary depending on the context or goal of the message. This provides flexibility and allows the user experience to be optimized depending on the situation.

[0016] In an additional embodiment of the specified device, the change instruction includes updating the appearance of the CTA button. Preferably, updating the appearance of the CTA button can be consistent with the content of the media playback being played on the screen. When the CTA button changes its appearance to match the content of the message (such as rain clouds in a severe weather warning), a clear and direct link is immediately established between the content displayed on the screen and the content expected by the observer. The intuitive and thematically appropriate appearance shortens the processing time in the observer's brain. Instead of explaining the abstract button, the observer will immediately know what action is expected through the updated appearance of the CTA button. Thematically appropriate symbols can cause stronger emotional responses than ordinary buttons. In the rain cloud example, this can increase the sense of urgency and importance, which can increase the possibility of response. For people who have difficulty reading or understanding text, visual symbols can provide a clearer and more direct form of communication. Thematic design increases usability and leads to a more positive user experience because it shows that the designer of the media reproduction has carefully considered the content and user journey. Images or symbols are generally universally understood, thereby overcoming language barriers. This may be particularly important if the media playback is intended for multicultural or multilingual audiences. People also tend to retain visual information better than text-based information. A memorable icon on the CTA button helps viewers remember the message and the associated prompt. An updated look of the CTA button that matches the content on the screen creates a consistent and harmonious user experience. This helps avoid confusion or frustration.

[0017] In another embodiment of the specified device, the communication interface is further configured to receive a motion signal from the remote control indicating the movement of the remote control. The clock is configured to create a motion timestamp that records the start of the movement based on the motion signal. Considering the motion signal sent by the remote control and recording the start of the movement significantly improves the capture of the observer's attention. People usually react to stimuli (e.g., multimedia information on the screen) with physical movement first, even before they make a conscious decision. Therefore, the motion signal indicating the movement of the remote control can be the first sign that the observer reacts to the message (even before they touch the CTA button). If the observer moves the remote control immediately after the prompt to press the CTA button, but does not touch or press the CTA button, this may indicate hesitation or uncertainty. This information can be used as a further criterion to evaluate how the observer perceives the message and how effective the message is in terms of the expected response. If the observer moves the remote control immediately when the action is expected, this indicates that their attention is very focused on the screen and the message. In other words, if the observer takes a relatively long time to pick up the remote control to press the CTA button, this may indicate that the prompt to press the CTA button or the entire multimedia media playback being played is misleading, and the observer understands the content quite accidentally. This can serve as an additional indicator of the effectiveness of multimedia playback. The longer the time between the motion timestamp and the touch or press of the CTA button, the more complex the decision may be for the observer, indicating that additional clarity or information is needed. The combination of motion timestamps, touch timestamps, and release timestamps also allows for a more detailed and comprehensive picture of the observer's reaction and interaction. This leads to a more precise analysis and interpretation of the data. Even if the observer ultimately decides not to press the CTA button, moving the remote control only in response to the prompt to press the CTA button can be interpreted as a sign of participation or interest. As shown above, capturing such subtle signals can help deepen the understanding of what impresses and attracts the observer or not. By capturing motion data, it can be determined how intuitive the prompt or message is to the observer. For example, based on how many observers move the remote control immediately after the prompt, it can be inferred how clear and easy it is to understand the prompt. Considering motion signals significantly improves the ability of a specified device to measure the observer's attention, participation, and response. This leads to a deeper and more accurate insight into the observer's behavior and the effectiveness of the message or prompt.

[0018] In a specific embodiment of the specified device, the clock is also configured to create a rest timestamp that records the end of the movement based on the motion signal. The rest timestamp that records the end of the movement expands the depth of the data and provides additional insights into the behavior and attention of the observer. The motion timestamp and the rest timestamp can be used to determine the exact duration of the observer's active participation or attention. This can provide information about the degree to which the observer pays attention to the multimedia media playback being played on the screen and how to effectively attract the observer's attention. For example, if there is a long period of time between the start of the movement and the rest, and if the user has held the remote control in his hand for a long time without pressing the CTA button, this may indicate that the observer is distracted or their attention is focused elsewhere. In other words, the short period between the start of the movement and the rest (which includes the activation of the CTA button) can indicate a higher level of participation and determination. This data obtained from the combination of motion timestamps, rest timestamps, touch timestamps, and release timestamps can be used to optimize multimedia content. For example, if it is found that many observers pick up the remote control and hold it in their hands for an extended period of time without pressing the CTA button, this may indicate that the content needs to be remade to be more effective. By understanding how long the observer holds the remote in their hand and whether they eventually press the CTA button, the call to action can be fine-tuned to be more effective. Therefore, in combination with other data, these timestamps can be used to paint a more comprehensive picture of observer behavior. For example, rest timestamps placed in the emotional context of multimedia media playback can be used to infer the extent to which the observer is touched by the scene, which in turn can be used to infer whether the instruction to press the CTA button is given at the right time. Overall, the introduction of rest timestamps that record the end of the remote control's movement allows for a more precise and in-depth recording of observers' attention and reactions. Depending on what the CTA button is used for, this can provide valuable insights for content creators, advertisers and other stakeholders.

[0019] In yet another embodiment of the designated device, the clock is further configured to create a presentation timestamp that records when the prompt is displayed to the observer. By comparing the presentation timestamp and the motion timestamp, it can be determined how quickly the observer reacts to the prompt to press the CTA button. A quick reaction will indicate a higher level of attention and interest. In other words, if the observer holds the remote control in their hands for an extended period of time before reacting, it indicates that they are thinking about the information or prompt presented. This can provide valuable information about which content or prompts may cause uncertainty or worry in the observer. Additionally, if it is determined that a group of observers tend to respond faster or slower to certain types of prompts (based on the time between the presentation timestamp and the motion timestamp), this can be used to determine the best timing for future prompts. The total time that the observer holds the remote control in their hands combined with the time when the prompt is presented can be used to evaluate the overall effectiveness of multimedia media playback. This is particularly useful for advertisers or content creators who want to measure the success of their messages. The time span between the presentation timestamp and the motion timestamp can be used as an information basis for determining the level of distraction of the observer. Then, this can be used to improve the prompt to press the CTA button to speed up the observer's response. Understanding how long viewers typically take to respond to a prompt and how long they remain engaged (holding the remote in their hand) provides valuable feedback to content creators in order to optimize multimedia content and make it more effective.

[0020] In another embodiment of the specified device, the clock is also suitable for creating a fade-out timestamp, which records when the displayed prompt for the observer fades out again. The introduction of the fade-out timestamp (which records the time when the prompt displayed to the viewer fades out again) provides additional advantages and possibilities for analyzing and interpreting observer reactions. By comparing the presentation timestamp and the fade-out timestamp, the exact duration of the prompt displayed on the screen can be determined. This provides insight into the average time that is considered to be effective for such prompts. Compared with the observer's (presentation timestamp and motion timestamp) reaction time, the time between the prompt being displayed and fading out provides insight into how effective the prompt is. For example, if the observer reacts quickly before the prompt fades out, this indicates that the prompt is effective. The fade-out timestamp can be used to determine whether the observer makes their decision (i.e., presses the CTA button) while the prompt is still displayed or after the prompt is displayed. This helps to understand whether the decision is made spontaneously based on the prompt, or whether the observer needs more time to think about the decision. It can also be inferred how well the observer can remember the prompt (if applicable) and how concise it is for their memory. In other words, if it is found that many observers respond only after the cue has faded out, this may indicate that the cue should be displayed longer. Conversely, if most observers respond quickly, the cue duration can be shortened to optimize the flow of media playback. By understanding when observers typically respond (before or after the cue fades out), content creators can adjust their cueing strategies to maximize interaction and engagement. In summary, fade-out timestamps allow for more accurate analysis of the effectiveness of cues and provide valuable data to optimize the presentation and timing of such cues to maximize observer attention and engagement.

[0021] According to another aspect of the present invention, a method for capturing an observer's attention to a playback of multimedia media played on a screen comprises the following steps: presenting to the observer on the screen a prompt to press a call to action button (CTA button) of a remote control; creating a touch timestamp when the observer touches the CTA button on the remote control; creating a release timestamp when the observer stops touching the CTA button on the remote control; and creating a trigger timestamp when the observer presses the CTA button on the remote control.

[0022] In a further embodiment, the designation method includes the step of displaying a CTA button on the screen.

[0023] In a further embodiment, the designation method comprises the step of sending a change instruction to the remote control to change the appearance of the CTA button, wherein a request is sent to the viewer to press the CTA button.

[0024] In further embodiments of the specified method, changing the instructions includes updating the appearance of the CTA button.

[0025] In a further embodiment, the designation method includes the steps of: receiving a motion signal from the remote controller indicating movement of the remote controller; and creating a motion timestamp recording the start of the movement based on the motion signal.

[0026] In a further embodiment, the designation method comprises the step of creating a rest timestamp recording the end of the movement based on the motion signal.

[0027] In a further embodiment, the designation method includes the step of creating a presentation timestamp that records when the prompt to the observer is displayed.

[0028] In a further embodiment, the designation method comprises the step of creating a fade-out timestamp recording when the displayed cue to the observer fades out again.

[0029] According to another aspect of the present invention, a control device is provided for implementing one of the specified methods.

[0030] In another embodiment of the specified device, the specified device includes a memory and a processor. The specified method is stored in the memory in the form of a computer program, and the processor is provided so as to execute the method when the computer program is loaded from the memory into the processor.

[0031] According to another aspect of the present invention, a computer program comprises program code means for executing all the steps of a specified method when the computer program is executed on one of an electronic device or a specified device.

[0032] According to another aspect of the invention, a computer program product comprises a program code which is stored on a computer-readable data carrier and which, when executed on a data processing device, carries out a specified method. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A schematic representation of a system comprising a television set and a remote control is shown;

[0034] Figure 2 Shown is a Figure 1 a schematic representation of a network of systems; and

[0035] Figure 3 yes Figure 2 A sequence diagram of the processes in the network shown. DETAILED DESCRIPTION

[0036] In the drawings, identical technical elements have the same reference numerals and are described only once. The figures are only schematic and, in particular, do not reflect actual geometric proportions.

[0037] refer to Figure 1, which shows a schematic representation of a system 2 comprising a television set 4 and a remote control 6.

[0038] The television set 4 comprises a screen 8 connected to a set-top box 10. The set-top box 10 receives a data stream containing a video 14 via a network connection 12, which is for example connected to a network on a Figure 1 The set-top box 10 filters the video 14 from the data stream and outputs the video signal carrying the video 14 to the screen 8 via the screen cable 16 so that the video 14 is displayed on the screen 8.

[0039] Before discussing the video 14 in more detail, the control of the television 4 using the remote control 6 will first be discussed.

[0040] The remote control 6 comprises a first keyboard 16 and a second keyboard 18 separated from each other by a directional key 20. A confirmation button 22 is located in the center of the directional key 20. This structure is basically known and does not require further explanation. The keyboards 16, 18 and the buttons of the directional key 20 and the confirmation button 22 are used to enter control commands in order to control the functions of the television set 4. To this end, the input is sent to the set-top box 10 via a transmission signal 24, which filters the input from the transmission signal 24 and then performs a function corresponding to the input on the television set 4, such as volume control, program selection, etc.

[0041] Special buttons on the remote control (the Figure 1 1 and 2 (shown in shading and with reference numeral 26) for a special function on the television set 4. The idea is to implement this as a call to action button (hereinafter referred to as CTA button 26) to motivate or guide the viewer and thus the user of the remote control 6 to perform a specific action. In this embodiment, the specific action is exemplary with respect to the video 14, which is implemented as a weather report announcing severe weather in the form of a cold wave. The purpose of the specific action is for the viewer to actively confirm that they have noticed the severe weather reported in the weather report. To this end, the viewer is prompted by a corresponding image 28 of the CTA button 26 superimposed on the video 14.

[0042] To explain the implementation of this concept, refer to Figure 2 , which shows the integration of Figure 1 The system 2 is connected to a network 30 of other similar systems not shown. These other integrated systems are Figure 2 In the figure are indicated by further network connections 12', 12", and 12'".

[0043] The system 2 and other systems are connected to each other in a network 30 via bidirectional network connections as network connections 12, which can be realized, for example, via the Internet 32. The network connection should be as trouble-free as possible, which can be achieved, for example, by redundancy and / or by satellite network connections such as those provided by Starlink. Furthermore, a programming system 34 and a control system 36 are integrated into the network 30, which together implement the concept behind the CTA button 26 mentioned above. In contrast, the system 2 described above is referred to as the subscriber system 2 below.

[0044] The programming system 34 is used below to define and manage so-called campaigns. In the following, a campaign is understood to be an organized action or series of actions used to motivate viewers of the video 14 or other videos on the screen 8 to press the CTA button 26, in order to confirm that they are aware of the severe weather. However, campaigns within the meaning of the present disclosure may also have other goals, such as promoting products or services, ideas, or political agendas. In order to define or control campaigns, a content management system (referred to as CMS) 38 is implemented in the programming system 34, with which the operator can carry out the necessary programming steps. Programming is a known skill and depends on the programming language chosen. Therefore, we will not describe it in further detail here.

[0045] The most effective way to implement the system is to utilize the subscriber system of interested participant registration.The main advantage of the subscriber system is that it also avoids the data protection problem that occurs when collecting the data of the participant in the necessary mode of implementing the aforementioned conception.Another advantage of the subscriber system is that if the severe weather message in the video 14 is relevant to the participant, then these participants can be proposed specifically.For this reason, a subscriber management system 39 can be arranged in the programming system 34, which can be used to type, manage and delete (if necessary) participants.In order to uniquely identify the participant, for example, the identification of the identification of the set-top box 10, the identification of the remote controller 6 and the identification of the family with the system 2 can be stored in the subscriber management system 39.

[0046] However, the activity is controlled by a control system 36. Here, the activity programmed by the programming system 34 is managed, and (if necessary) predetermined parameters are provided when the activity starts. For example, in the case of the above-mentioned severe weather warning, this can be the completion of the information text of the text module pre-stored as the data with such as expected temperature, time and the like. In addition, when the activity starts, for example, a group of participants to be targeted by the activity is determined based on the identification of the set-top box 10. Such a group of participants shall be referred to as a group hereinafter. The control system 36 is also responsible for sending activity data to each set-top box 10, such as the identification, media data, text, etc. of the activity. In order to evaluate the activity, the control system 36 can also receive evaluation data from the individual participants of the group, and the evaluation data mainly includes feedback about which CTA button 26 on the remote controller 6 is operated. Finally, the control system 36 can also be used for performing evaluation, such as the A / B test known per se.

[0047] The control system 36 solves the activity management service 40 via the network connection 12 in the set-top box 10 of the corresponding subscriber system 2, which controls the corresponding activities started on the participant side in the subscriber system 2. The activity management service 40 can be designed as a physically independent unit in principle, for example, to supplement the functionality of the older set-top box according to the described concept. Alternatively, the activity management service 40 can also be stored in the set-top box 10 as a program, which will be preferred for cost reasons. In order to manage the activities of the subscriber side, the activity management service 40 stores the above-mentioned activity data, and provides important information about the family targeted by the activity so that the activity is evaluated. In the case of the above severe weather alert, this information can be, for example, the age of the family members, etc., so that it can be estimated according to the reaction of the participant or the observer how urgent any emergency measures are when the CTA button 26 is not pressed.

[0048] The activity management service 40 also addresses other components of the set-top box 10 to control the activity. In the present case, these will be: an attention sensor 42 having a communication interface with the remote control 6 designed as a Bluetooth Low Energy interface (BLE interface); a communication interface with the screen 8 designed as a High Definition Multimedia Interface (HDMI interface 44); and the actual operating system of the set-top box 10, which is typically, but not limited to, designed as an Android operating system 46. The attention sensor 42 will be described in more detail later.

[0049] Via the BLE interface of the attention sensor 42, the activity management service 40 sends a request to the observer or subscriber to press the CTA button 26 in the transmission signal 24. For this purpose, the CTA button 26 can preferably be designed to be variable, whereby the activity management service 40 can send an image in addition to or instead of the request about how to design the CTA button 26 for the activity in a specific way. When sending, the activity management service 40 waits for a response from the remote control 6 as to whether the CTA button 26 on the remote control 6 has been pressed. In the case of a response, the activity management service 40 can capture a timestamp recording the actuation of the CTA button (this is hereinafter referred to as a remote control unit event (RCU event)). Alternatively or additionally, the activity management service 40 can also capture a timestamp where the recorded video is located. Unlike the RCU event, this event is called a digital multimedia broadcast event (DMB event). Although the BLE interface of the attention sensor 42 can in principle use any transmission protocol, the corresponding interface must be designed for two-way communication.

[0050] In contrast, bidirectional communication is not absolutely necessary for the HDMI interface 44. Here, the activity management service 40 only sends data to the screen 8 without waiting for a response. When starting an activity, the data sent to the screen 8 includes a request to press the CTA button 26. Figure 1 In the example shown in FIG. 1 , the request takes the form of an illustration 28 of a CTA button 26 on the screen 8 and superimposed on the video 14. In addition, the activity management service 40 may also transmit background information and other data about the activity to the screen 8 for display (if necessary) via the HDMI interface 44. Finally, the activity management service 40 hides all of this data again at an appropriate time, for example after the CTA button 26 has been pressed or after the activity has ended.

[0051] Finally, the activity management service 40 may also modify the Android operating system 46, for example, to automatically play back a video, start a program, or install or establish a communication channel (e.g., establish a phone connection). This will be selected based on the purpose of the application. For example, in the case of the severe weather warning mentioned above, if the subscriber is over a certain threshold age and is expected to need help, a video communication link may be established so that help can be subsequently coordinated by phone.

[0052] Should refer to Figure 3 to illustrate the message flow during the activity.

[0053] First, the control system 36 sends a push message 50 to the activity management service 40 in the set-top box 10, which contains all the information required to present the activity to the observer or subscriber and prompt them to press the CTA button 26. In response to the push message 50, the activity management service 40 generates a push command 52 and a configuration instruction 54. In addition to optional background information about the activity (e.g., severe weather warnings), the push command 52 contains the image 28 of the CTA button 26, which will be superimposed with the video 14 as a request to press the CTA button 26 and sent to the screen 8. At the same time, the configuration instruction 54 also contains the image 28 of the CTA button 26 and the instructions to the remote control to design it in a corresponding manner. However, alternatively, the configuration instruction can also be separated from the image, and for example, only the CTA button 26 is illuminated.

[0054] Subsequently, the activity management service 40 waits for feedback 56 from the remote control 6 as to whether the CTA button 26 has actually been operated, and upon receiving the feedback 56, sends a feedback message 58 to the control system to confirm the operation of the CTA button.

[0055] Finally, the attention sensor 42 is explained in more detail, which is a device for detecting the attention of the observer to the multimedia media playback 14 played on the screen 8 using the remote control 6.

[0056] The attention sensor 42 includes a clock 60. The clock 60 creates various timestamps for recording various events. The most important timestamps are the touch timestamp that records when the observer touches the CTA button 26 on the remote control, and the release timestamp that records when the observer stops touching the CTA button on the remote control. The clock also creates a trigger timestamp when the observer presses the CTA button 26 on the remote control.

[0057] Via the BLE interface, the attention sensor 42 receives a motion signal from the remote controller 6 indicating the movement of the remote controller 6. Based on the motion signal, the clock 60 creates a motion timestamp recording the start of the movement. Based on the motion signal, the clock 60 is also configured to create a rest timestamp recording the end of the movement.

[0058] The clock 60 is also configured to create a presentation timestamp that records when a request to a viewer is displayed, and a fade-out timestamp that records when a displayed request to a viewer is faded out again.

Claims

1. A device (40) for capturing the attention of an observer to a playback of multimedia media played on a screen (8) using a remote control (6) when a request for the observer to press a call to action (CTA) button (26) of the remote control (6) is displayed on the screen (8), the device comprising a clock (60) for: creating a touch timestamp when the observer touches the CTA button (26) on the remote control (6); When the observer stops touching the CTA button (26) on the remote control (6), creating a release timestamp; And when the viewer presses the CTA button (26) on the remote control (6), a triggering timestamp is created.

2. The device (40) according to claim 1, wherein: The request to the viewer includes configuration instructions for displaying the CTA button (26) on the screen (8).

3. The device (40) according to claim 1 or 2, comprising a communication interface (42) arranged to send a change instruction to the remote control (6) in order to request the observer to press the CTA button (26) and change the appearance of the CTA button (26), wherein The change instructions include updating the appearance of the CTA button (26).

4. The device (40) according to claim 3, wherein: The communication interface is further configured to receive a motion signal from the remote control (6) indicating movement of the remote control (6), and wherein the clock (60) is configured to create a motion timestamp based on the motion signal, the motion timestamp recording the start of the movement.

5. The device (40) according to claim 4, wherein: The clock (60) is further configured to create a rest timestamp based on the motion signal, the rest timestamp recording the end of the movement.

6. The device (40) according to any one of the preceding claims, wherein: The clock (60) is also configured to create a presentation timestamp that records when a prompt is displayed to the observer.

7. The device (40) according to claim 6, wherein: The clock (60) is also configured to create a fade-out timestamp that records when the prompt to the observer is faded out again.

8. A remote control (6) for interacting with a device (40) according to any one of the preceding claims, comprising: a CTA button (26) having a touch sensor for detecting a touch of the CTA button (26) by the observer and a pressure pick-up sensor for detecting activation of the CTA button (26) by the observer; and a communication interface for sending sensor signals from the touch sensor and the pressure pick-up sensor to the communication interface of the remote controller (6).

9. A system (2), comprising: A device (40) according to any one of claims 1 to 7, and a remote control (6) according to claim 8.

10. A method for capturing an observer's attention to a multimedia media playback played on a screen (8), comprising the following steps: presenting on the screen (8) a prompt for the observer to press a call to action (CTA) button (26) of the remote control (6); When the observer touches the CTA button (26) on the remote control (6), creating a touch timestamp; When the observer stops touching the CTA button (26) on the remote control (6), creating a release timestamp; as well as When the viewer presses the CTA button (26) on the remote control (6), a trigger timestamp is created.

11. The method according to claim 11, comprising: The CTA button (26) is displayed on the screen (8).

12. The method according to claim 10 or 11, comprising sending a change instruction for changing the appearance of the CTA button (26) to the remote control (6), wherein: A request is sent to the viewer to press the CTA button 26, wherein the change instruction includes updating the appearance of the CTA button (26).

13. The method according to claim 12, comprising the steps of: Receiving a motion signal from the remote control (6) indicating movement of the remote control (6); and creating a motion timestamp based on the motion signal, the motion timestamp recording the start of the movement.

14. The method of claim 13, comprising creating a rest time stamp based on the motion signal, wherein: The rest timestamp records the end of the move.

15. The method according to any one of the preceding claims 11 to 14, comprising: - creating a presentation timestamp recording when the prompt was displayed to the observer, and / or - Creating a fade-out timestamp which records when the displayed cue to the observer is faded out again.

Images