Smart-Cam Facial Expression Anonymization via Trusted Mediator

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In Web and Cloud computing infrastructures, there is a challenge in monitoring user responses to Web content and advertising while protecting user privacy, as existing anonymity networks can be easily circumvented, and detailed user reaction data may infringe on personal privacy.

Innovation Solution

The implementation of a smart-cam unit that processes image and audio streams to generate user attention and reaction data, combined with a trusted third-party service that anonymizes user data and provides it to content providers, ensuring user privacy through techniques like Tor-based routing and Zero-Knowledge Proof authentication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If anonymity networks are used to protect user privacy, then user anonymity is improved, but the system is easily circumvented by creating unique URLs for each user

Engineering Contradiction:
Improveuser anonymityVSAvoidanonymity protection system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces a trusted third-party service as an intermediary between the user and the content provider. This mediator collects user reaction data through the smart-cam, anonymizes it using cryptographic techniques including Zero-Knowledge Proof, and then provides the anonymized data to content providers. This intermediary approach maintains user anonymity while enabling data collection, resolving the contradiction between anonymity reliability and system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If detailed user reaction data is collected to provide marketing insights, then productivity is improved, but user privacy is infringed

Engineering Contradiction:
Improvemarketing insightsVSAvoiduser privacy infringement
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts only the necessary reaction data elements from the complete user profile. The smart-cam captures facial expressions and eye movements, which are then processed to extract specific reaction metrics (such as emotional responses to advertising) while leaving out personal identifying information. This extraction approach enables marketing insights to be generated from anonymized reaction data, resolving the contradiction between productivity improvement and privacy protection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The trusted third-party service acts as an intermediary that collects detailed user reaction data, processes it through anonymization algorithms, and provides only the anonymized results to content providers. This mediator ensures that detailed data collection for marketing insights does not directly infringe on user privacy, as the privacy protection layer is maintained throughout the data pipeline.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If smart-cam monitors user facial expressions to capture reaction data, then measurement precision is improved, but user privacy concerns increase

Engineering Contradiction:
Improveuser reaction dataVSAvoidprivacy concerns
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent replaces direct mechanical observation of users with automated image processing and cryptographic anonymization systems. The smart-cam captures facial expressions and eye movements, which are then processed through computer vision algorithms to extract reaction data. This substitution of mechanical monitoring with automated processing, combined with cryptographic anonymization, enables precise measurement while reducing privacy concerns by removing the need for direct human observation and processing of personal data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11727426B2Anonymizing facial expression data with a smart-cam
Publication Date: 2023.08.15 ADEIA MEDIA HOLDINGS INC
  • US11727426B2 patent drawing
  • US11727426B2 patent drawing
  • US11727426B2 patent drawing

AI summary

A method of responding to a criterion-based request for information collected from users meeting the criterion while complying with a user-requested privacy requirement. In one embodiment a request is received for data comprising facial or audio expressions for users who meet the criterion. A program monitors activities indicative of user attention or user reaction based on face tracking, face detection, face feature detection, eye gaze determination, eye tracking, audio expression determination, or determination of an emotional state. When a user requests a high level of privacy, the timestream data collected for the user is aggregated with timestream data collected for other users into a statistical dataset by processing the timestreams to ensure the high level of privacy in the statistical dataset which is provided to a content provider without providing data collected for the user who has requested the high level of privacy.