Live Streaming Reaction Overlay for Co-located Participants

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing social media systems lack the ability to automatically determine and present participants' reactions to live streaming videos, especially for co-located participants, which limits the real-time insight into the sentiment and mood of events being streamed.

Innovation Solution

A computer-implemented method that identifies co-located participants, monitors their behavior through sensor data and user device activity, and provides visual representations of their reactions within a user interface displaying the live streaming video, allowing for real-time feedback from participants physically present at the event.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If sensor data and user device activity are monitored to automatically determine participants' reactions, then real-time insight into sentiment and mood is improved, but device complexity and data processing requirements increase

Engineering Contradiction:
Improvesentiment and mood insightVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary system comprising sensor data collection modules, behavior monitoring components, and reaction determination algorithms that act as a mediator between participants' physical reactions and the live streaming content. This intermediary layer processes sensor data from devices worn by participants, analyzes behavior patterns, and generates visual representations of reactions without requiring direct modification of the live streaming infrastructure itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates visual copies or representations of participants' reactions by analyzing sensor data and generating standardized visual indicators (such as emojis, icons, or graphical elements) that represent detected emotions and states. These visual copies are then overlaid on or displayed alongside the live streaming video, providing insight into sentiment without requiring direct access to or modification of the original video feed or participants' devices.

Inventive Principle:
Principle #26Copying

2Productivity

If visual representations of reactions are provided within the user interface, then engagement and emotional connection for remote viewers is improved, but information display complexity increases

Engineering Contradiction:
Improveviewer engagementVSAvoiduser interface complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local quality by placing specific visual reaction indicators at strategic locations within the user interface, such as overlaying reaction icons near the corresponding participants in the video feed or positioning them in dedicated reaction panels. Each visual representation is localized to its source participant, allowing viewers to easily associate reactions with specific individuals without creating a uniformly complex interface throughout.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system implements partial action by selectively displaying visual representations only for participants who have opted in to share their reaction data, rather than attempting to monitor and display reactions from all participants. This approach provides sufficient engagement information without overwhelming the interface with excessive visual elements, maintaining a balance between informative density and interface simplicity.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If co-located participants are identified and monitored, then real-time feedback from physically present participants is improved, but privacy concerns and data collection requirements increase

Engineering Contradiction:
Improvereal-time feedbackVSAvoidprivacy concerns
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent implements preliminary action by obtaining explicit participant consent and opt-in permissions before collecting any sensor data or monitoring behavior. The system establishes privacy protocols and data collection agreements in advance, clearly informing participants what data will be collected, how it will be used, and who will have access to it. This preliminary consent process ensures that real-time feedback can be gathered only from participants who have voluntarily agreed to the data collection terms.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies local quality to privacy protection by implementing differentiated data collection and processing for different participants based on their individual privacy settings and consent levels. Each participant's data is handled according to their specific preferences, with some participants opting for full monitoring, others for limited monitoring, and some for no monitoring at all. This localized approach to privacy management allows real-time feedback from consenting participants while respecting the privacy choices of others.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11240558B2Automatically determining and presenting participants' reactions to live streaming videos
Publication Date: 2022.02.01 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11240558B2 patent drawing
  • US11240558B2 patent drawing
  • US11240558B2 patent drawing

AI summary

A computer-implemented method includes: identifying, by a computing device, one or more participants associated with a live streaming video, wherein the one or more participants are co-located; monitoring, by the computing device, behavior of each of the one or more participants, wherein the monitoring comprises monitoring sensor data associated with the one or more participants; automatically determining, by the computing device, respective reactions of each of the one or more participants based on the monitoring the behavior; and providing, by the computing device, respective visual representations of the respective reactions of each of the one or more participants for display within a user interface that is presenting the live streaming video.