Reaction Annotation System Using Event-Triggered Sensor Activation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems lack an effective method to annotate and organize content based on user reactions, making it difficult for users to search and share experiences related to emotions evoked by various forms of content such as movies, music, and geographical locations.

Innovation Solution

A system that detects user reactions using sensors like cameras, microphones, and GPS devices, and annotates content in real-time or offline, allowing users to opt-in for reaction data storage and aggregation in a searchable repository, enabling users to search for content based on emotional responses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sensors are continuously activated to detect user reactions in real-time, then the accuracy and completeness of reaction data is improved, but the energy consumption and device resource usage increases

Engineering Contradiction:
Improvereaction data accuracyVSAvoiddevice energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system uses periodic sensing intervals and event-triggered detection rather than continuous sensing. Sensors are activated at specific intervals or when predefined events occur (e.g., user interacts with content, content changes), allowing the system to capture meaningful reaction data while significantly reducing energy consumption compared to continuous monitoring.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system pre-processes and filters content to identify segments likely to elicit user reactions before activating sensors. By analyzing content characteristics (e.g., emotional intensity, interaction opportunities) in advance, the system proactively determines when sensing should occur, optimizing the balance between data quality and energy usage.

Inventive Principle:
Principle #10Preliminary action

2Speed

If all user reaction data is stored locally for immediate access, then the speed of retrieving personal reaction history is improved, but the device storage requirements and data security risks increase

Engineering Contradiction:
Improvedata retrieval speedVSAvoiddevice storage capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The system extracts and separates reaction data from local device storage, transferring it to remote cloud-based servers. Only essential metadata and aggregated summaries are retained locally, while detailed reaction data is stored remotely. This extraction approach enables fast retrieval of frequently accessed information locally while maintaining comprehensive data availability in the cloud, reducing local storage requirements significantly.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system introduces a cloud-based server as an intermediary between the user device and the reaction data. The server acts as a mediator that stores, manages, and provides access to reaction data, allowing the device to query and retrieve data as needed without maintaining large local storage capacity. This intermediary architecture balances local access speed with remote storage efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If detailed user reaction data is collected and stored, then the ability to perform personalized content recommendations is improved, but the user privacy risks and data security requirements increase

Engineering Contradiction:
Improvepersonalization capabilityVSAvoidprivacy risk
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system applies different levels of privacy protection and data processing to different types of reaction data based on their sensitivity. Emotional responses to entertainment content may be processed differently than reactions to personal or sensitive content. The system selectively aggregates, anonymizes, or encrypts data based on its nature and context, providing personalized services while minimizing privacy exposure through differentiated data handling approaches.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system creates and uses anonymized copies of user reaction data for analysis and recommendation purposes, rather than processing raw personal data directly. By working with de-identified data copies that retain the essential patterns and preferences needed for personalization, the system can deliver tailored content recommendations while significantly reducing the privacy risks associated with storing and processing detailed personal reaction information.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10678852B2Content reaction annotations
Publication Date: 2020.06.09 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10678852B2 patent drawing
  • US10678852B2 patent drawing
  • US10678852B2 patent drawing

AI summary

Among other things, one or more techniques and/or systems are provided for annotating content based upon user reaction data and/or for maintaining a searchable content repository. That is, a user may request and/or opt-in for user reaction data to be detected while a user is experiencing content (e.g., watching a movie, walking through a park, interacting with a website, participating on a phone conversation, etc.). Metadata associated with the content may be used to determine when and/or what sensors to use to detect the user reaction data (e.g., metadata specifying an emotional part of a movie). The content may be annotated with a reaction annotation corresponding to the user reaction data, which may be used to organize, search, and/or interact with the content. A search interface may allow users to search for content based upon annotation data and/or aggregated annotation data of one or more users who experienced the content.