Shared Viewing Reaction Detection for Synchronized User Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing shared viewing technologies, such as screen-sharing and videoconferencing, limit interaction between group viewers, requiring separate communication methods and failing to emulate an in-person viewing experience.
Innovation Solution
A shared viewing application that uses sensors to detect user reactions, such as speech, gestures, and facial expressions, and conveys these reactions to other users through synchronized playback, including visual, audio, and haptic effects, tailored to individual user preferences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If screen-sharing or videoconferencing is used for shared viewing, then multiple users can view content simultaneously from different locations, but interaction between users is limited and cannot emulate in-person viewing experience
Solution Approach 1:
The patent introduces sensors (cameras, microphones, motion detectors) as intermediaries to capture user reactions and convey them to other participants. These sensors act as mediators between physical in-person interactions and virtual shared viewing, enabling gestures, facial expressions, and spoken reactions to be detected and transmitted through the communication network to enhance interaction quality.
Solution Approach 2:
The patent replaces physical mechanical interactions (pointing, gesturing, talking in person) with digital signal transmission. Physical actions captured by sensors are converted into digital data packets transmitted over communication networks, substituting the mechanical in-person interaction system with an electronic information transmission system that achieves similar interaction effects remotely.
2Ease of operation
If separate communication methods are used for interaction, then users can communicate independently, but the viewing experience becomes fragmented and less engaging
Solution Approach 1:
The patent merges communication functionality with the shared viewing experience by integrating reaction transmission directly into the viewing application. Users can communicate through the same interface used for viewing, combining content consumption and interaction in a unified system rather than separate independent channels, thereby maintaining engagement while enabling communication.
Solution Approach 2:
The patent implements feedback mechanisms where users' reactions (detected by sensors) are transmitted to other participants in real-time during viewing. This creates a closed-loop feedback system where user actions directly influence the shared viewing experience, making interactions immediate and responsive rather than separate and delayed, thus enhancing overall engagement.
Data Source
AI summary
In systems and methods for enhancing group watch experiences, a first user's reaction is detected using multiple sensors, e.g., at least one camera and a microphone, and may be combined with context information to determine an action to perform at user equipment devices of other users participating in the group watch to convey the first user's reaction. Images from the at least one camera can be used to determine a portion of the screen to which the user's reaction is directed and/or another user to whom the reaction is directed. The reaction may be conveyed using one or more of an audio effect, a visual effect, haptic effect or text, e.g., to highlight the determined portion or user, display an icon and/or output an audio or video clip. A signal for providing haptic feedback may be transmitted to the user equipment device of the determined user.